00010000:00010000:0.0F:1777502230.031754:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502231.055820:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1777502231.695898:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3865704-aa9b-444e-8420-b5af90b3c217:2370:1863837563149568:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502231.695916:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:2371:1863837563149696:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502231.696016:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563149952:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502231.696028:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563149824:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502231.696075:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563150080:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502231.700803:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563149952:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502231.700856:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563150080:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502231.700871:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c3865704-aa9b-444e-8420-b5af90b3c217:2370:1863837563149568:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502231.700901:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563149824:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502231.700918:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:2371:1863837563149696:192.168.202.127@tcp:400:kworker.0 00010000:00010000:1.0:1777502232.079778:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1777502232.797897:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502232.797922:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.797939:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.797954:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.797962:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502232.797969:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502232.797972:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf82aefd 00000080:00010000:0.0:1777502232.798015:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf82aefd from it ffffbd7f44853b58 00010000:00010000:0.0:1777502232.798020:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.798030:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.798047:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.798055:0:274351:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=8 00000080:00200008:0.0:1777502232.798082:0:274351:0:(file.c:6227:ll_getattr_dentry()) START file d77r.sanityn:[0x200000bd1:0x20:0x0](ffffa0755fdc0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1777502232.798087:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908),name=d77r.sanityn 00000002:00010000:0.0:1777502232.798098:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.798105:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 30 res 8589937617/32 (0 0) 00010000:00010000:0.0:1777502232.798143:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.798151:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.798160:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.798185:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150208:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.798444:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.800191:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150208:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.800208:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800219:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800224:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800242:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800252:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800274:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800282:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 5/2,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800290:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.800302:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a3100 x1863837563150208/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 576/584 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.800314:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800324:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937617/32 (0 0) 00000080:00200000:0.0:1777502232.800329:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1777502232.800344:0:274351:0:(llite_lib.c:2945:ll_update_inode()) inode=[0x200000bd1:0x20:0x0], updating i_size 7680 00000080:00010000:0.0:1777502232.800349:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x20:0x0](ffffa0755fdc0908) for lock 0xac3ccf43bf83471a 00000080:00010000:0.0:1777502232.800355:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00000080:00010000:0.0:1777502232.800358:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83471a from it ffffbd7f44853cb8 00010000:00010000:0.0:1777502232.800361:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800370:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.800431:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502232.800439:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.800445:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.800451:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.800455:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502232.800457:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502232.800459:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf82aefd 00000080:00010000:0.0:1777502232.800461:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf82aefd from it ffffbd7f44853bf8 00010000:00010000:0.0:1777502232.800463:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.800467:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.800473:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.800478:0:274351:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=266 00000080:00200000:0.0:1777502232.800482:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 44 00000080:00200008:0.0:1777502232.800488:0:274351:0:(file.c:1058:ll_file_open()) START file d77r.sanityn:[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags 704400 00000002:00010000:0.0:1777502232.800501:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1777502232.800531:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.800538:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1777502232.800554:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1777502232.800560:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a3100 x1863837563150464/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1777502232.800568:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.800583:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150464:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.800769:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.803833:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150464:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.803848:0:274351:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803856:0:274351:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803866:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803871:0:274351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803876:0:274351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803880:0:274351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07579edf600 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.803883:0:274351:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803897:0:274351:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803902:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803906:0:274351:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777502232.803909:0:274351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.803913:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.803923:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffffa075490a3100 x1863837563150464/t8589939066(8589939066) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1777502232.803932:0:274351:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffffa075490a3100 x1863837563150464/t8589939066(8589939066) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1777502232.803940:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1777502232.803953:0:274351:0:(llite_lib.c:2945:ll_update_inode()) inode=[0x200000bd1:0x20:0x0], updating i_size 7680 00000002:00100000:0.0:1777502232.803964:0:274351:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffffa075490a3100 x1863837563150464/t8589939066(8589939066) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1777502232.804016:0:274351:0:(file.c:6227:ll_getattr_dentry()) START file d77r.sanityn:[0x200000bd1:0x20:0x0](ffffa0755fdc0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1777502232.804020:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908),name=d77r.sanityn 00000002:00010000:0.0:1777502232.804033:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.804043:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.804056:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.804061:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502232.804065:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00000080:00010000:0.0:1777502232.804067:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x20:0x0](ffffa0755fdc0908) for lock 0xac3ccf43bf83471a 00000080:00010000:0.0:1777502232.804070:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83471a from it ffffbd7f44853cd8 00010000:00010000:0.0:1777502232.804072:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.804078:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1777502232.804143:0:274351:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) pos/size0/7680 32bit_api 0 00000002:00010000:0.0:1777502232.804156:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x20:0x0]) in obj [0x200000bd1:0x20:0x0], intent: readdir flags 0 00010000:00010000:0.0:1777502232.804163:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.804171:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1777502232.804711:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150592:192.168.202.127@tcp:37:rm.0 00000100:00100000:0.0:1777502232.804770:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777502232.808040:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150592:192.168.202.127@tcp:37:rm.0 00010000:00010000:0.0:1777502232.808682:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.808704:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:0.0:1777502232.808808:0:274351:0:(file.c:448:ll_file_release()) START file d77r.sanityn:[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags 704000 00000002:00100000:0.0:1777502232.808855:0:274351:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffffa075490a3100 x1863837563150464/t8589939066(8589939066) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1777502232.808867:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1777502232.808872:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a0a80 x1863837563150848/t0(0) o35->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1777502232.808891:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150848:192.168.202.127@tcp:35:rm.0 00000100:00100000:0.0:1777502232.808949:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777502232.811107:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563150848:192.168.202.127@tcp:35:rm.0 00000002:00100000:0.0:1777502232.811127:0:274351:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffffa075490a3100 x1863837563150464/t8589939066(8589939066) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1777502232.811187:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502232.811197:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.811210:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.811219:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.811224:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502232.811241:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502232.811253:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf82aefd 00000080:00010000:0.0:1777502232.811258:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf82aefd from it ffffbd7f44853bf8 00010000:00010000:0.0:1777502232.811260:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.811270:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.811282:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.811288:0:274351:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=266 00000080:00200000:0.0:1777502232.811294:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 44 00000080:00200008:0.0:1777502232.811301:0:274351:0:(file.c:1058:ll_file_open()) START file d77r.sanityn:[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags 704400 00000002:00010000:0.0:1777502232.811314:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1777502232.811353:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.811361:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1777502232.811371:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1777502232.811376:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a0a80 x1863837563151104/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1777502232.811385:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.811402:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151104:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.811545:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.812927:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151104:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.812959:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.812969:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.812978:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.812986:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 4/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.812996:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffffa075490a0a80 x1863837563151104/t8589939068(8589939068) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1777502232.813004:0:274351:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffffa075490a0a80 x1863837563151104/t8589939068(8589939068) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.813010:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.813017:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 16 res 8589937617/32 (0 0) 00000080:00200000:0.0:1777502232.813021:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1777502232.813033:0:274351:0:(llite_lib.c:2945:ll_update_inode()) inode=[0x200000bd1:0x20:0x0], updating i_size 7680 00000080:00010000:0.0:1777502232.813036:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x20:0x0](ffffa0755fdc0908) for lock 0xac3ccf43bf834728 00000080:00010000:0.0:1777502232.813040:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834728 from it ffffbd7f44853bd0 00010000:00010000:0.0:1777502232.813042:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.813057:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1777502232.813074:0:274351:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffffa075490a0a80 x1863837563151104/t8589939068(8589939068) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1777502232.813128:0:274351:0:(file.c:6227:ll_getattr_dentry()) START file d77r.sanityn:[0x200000bd1:0x20:0x0](ffffa0755fdc0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1777502232.813132:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908),name=d77r.sanityn 00000002:00010000:0.0:1777502232.813143:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000bd1:0x20:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.813149:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.813155:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1777502232.813159:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502232.813162:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00000080:00010000:0.0:1777502232.813164:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd1:0x20:0x0](ffffa0755fdc0908) for lock 0xac3ccf43bf83471a 00000080:00010000:0.0:1777502232.813166:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83471a from it ffffbd7f44853cd8 00010000:00010000:0.0:1777502232.813168:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.813172:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00000080:00200000:0.0:1777502232.813251:0:274351:0:(llite_lib.c:2730:ll_statfs()) VFS Op:sb=lustre (ffffa0756dba6800) d77r.sanityn proj=0 00000080:00000004:0.0:1777502232.813256:0:274351:0:(obd_class.h:1091:obd_statfs()) lustre-clilmv-ffffa0756dba6800: age 8144, max_age 8360 00800000:00000004:0.0:1777502232.813266:0:274351:0:(obd_class.h:1091:obd_statfs()) lustre-MDT0000-mdc-ffffa0756dba6800: age 8144, max_age 8360 00000100:00100000:0.0:1777502232.813290:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151232:192.168.202.127@tcp:41:rm.0 00000100:00100000:0.0:1777502232.813342:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.814134:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151232:192.168.202.127@tcp:41:rm.0 00800000:00000004:0.0:1777502232.814148:0:274351:0:(obd_class.h:1117:obd_statfs()) lustre-MDT0000-mdc-ffffa0756dba6800: update ffffa0754b550450 cache blocks 1870592/1885440 objects 233952/248396 00000080:00000004:0.0:1777502232.814153:0:274351:0:(obd_class.h:1117:obd_statfs()) lustre-clilmv-ffffa0756dba6800: update ffffa0754b551e10 cache blocks 1870592/1885440 objects 233952/248396 00000080:00000004:0.0:1777502232.814156:0:274351:0:(llite_lib.c:2593:ll_statfs_internal()) MDC blocks 1870592/1885440 objects 233952/248396 00000080:00200000:0.0:1777502232.814183:0:274351:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) pos/size0/7680 32bit_api 0 00000080:00200000:0.0:1777502232.814242:0:274351:0:(dir.c:331:ll_iterate()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) pos/size18446744073709551614/7680 32bit_api 0 00000080:00200000:0.0:1777502232.814262:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.814275:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-13, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.814279:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-13, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.814291:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-13,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.814318:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.814327:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.814335:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.814348:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151360:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.814389:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.816087:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151360:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.816101:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816127:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816135:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816145:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816154:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816164:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816171:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816177:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.816186:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a3100 x1863837563151360/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.816196:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.816214:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816223:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/532 (0 0) 00000080:00200000:0.0:1777502232.816238:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.816278:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x214:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.816388:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x214:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.816399:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x214:0x0](ffffa0757e5c6c08) for lock 0xac3ccf43bf83472f 00000080:00010000:0.0:1777502232.816408:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x214:0x0](ffffa0757e5c6c08) 00000080:00010000:0.0:1777502232.816411:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83472f from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.816414:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.816423:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.816443:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.816449:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-13, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.816483:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1777502232.816499:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075453b2000/0xac3ccf43bf82af0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba1015 expref: -99 pid: 269421 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.816559:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.816597:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x214:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.816651:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.816659:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1777502232.816664:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1777502232.816667:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede000/0xac3ccf43bf83472f lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4857 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.816680:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf400/0xac3ccf43bf83471a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9bc4818 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 1 00000020:00100000:0.0:1777502232.816694:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.816701:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a3100 x1863837563151616/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.816718:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151616:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.816766:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:2.0F:1777502232.818885:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.818927:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.818967:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410048 00000100:00100000:2.0:1777502232.818974:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410048 00000100:00100000:3.0F:1777502232.818981:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410176 00000100:00100000:3.0:1777502232.818992:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410176 00000100:00100000:3.0:1777502232.819030:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1040 00000100:00100000:2.0:1777502232.819040:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1041 00000100:00100000:3.0:1777502232.819041:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+6:188648:x1863837561410048:12345-192.168.202.127@tcp:104: 00000100:00100000:2.0:1777502232.819053:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:188648:x1863837561410176:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.819056:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1777502232.819064:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1777502232.819124:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1777502232.819129:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:188648:x1863837561410176:12345-192.168.202.127@tcp:104: Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.819135:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1041 00010000:00010000:3.0:1777502232.819136:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1777502232.819145:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:188648:x1863837561410048:12345-192.168.202.127@tcp:104: Request processed in 107us (265us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502232.819152:0:259773:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1777502232.819155:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1040 00010000:00010000:0.0:1777502232.819162:0:259773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1777502232.819173:0:259773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b759e00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.819179:0:259773:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1777502232.819185:0:259263:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.819193:0:259263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.819205:0:259773:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1777502232.819209:0:259263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07549ab2400 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.819217:0:259263:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.819218:0:259773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1777502232.819245:0:259263:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.819252:0:259263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.819263:0:259773:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b534e00/0xac3ccf43bf83450d lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x214:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc3f3c expref: -99 pid: 273062 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.819266:0:259263:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b534e00/0xac3ccf43bf83450d lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x214:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc3f3c expref: -99 pid: 273062 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.819322:0:259773:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1777502232.819323:0:259263:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.819331:0:259773:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.819341:0:259263:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.819359:0:259263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.819359:0:259773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1777502232.819381:0:259773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759e00/0xac3ccf43bf834617 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4214 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1777502232.819382:0:259263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2400/0xac3ccf43bf834656 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x214:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4310 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.819407:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.819408:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.819411:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.819411:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.819415:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.819416:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502232.819431:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563151872:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.819434:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563151744:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.820433:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563151744:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.820566:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563151872:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.822353:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3100 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563151616:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.822427:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x214:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.822437:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.822477:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x214:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.822487:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x214:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.822554:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.822569:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.822573:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.822591:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-19,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.822655:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.822663:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.822670:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.822683:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1f80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563152000:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.822727:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.824075:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1f80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563152000:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.824089:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824106:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824113:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824136:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824146:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824157:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824165:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824173:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.824183:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a1f80 x1863837563152000/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.824194:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.824205:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824215:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/539 (0 0) 00000080:00200000:0.0:1777502232.824220:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.824257:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x21b:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502232.824351:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x21b:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.824362:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x21b:0x0](ffffa0757e5c00c8) for lock 0xac3ccf43bf834736 00000080:00010000:0.0:1777502232.824371:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x21b:0x0](ffffa0757e5c00c8) 00000080:00010000:0.0:1777502232.824374:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834736 from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.824378:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.824387:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.824408:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.824413:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.824446:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.824465:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x21b:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.824504:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.824511:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.824514:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834736 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc488f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.824533:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.824539:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a1f80 x1863837563152256/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.824556:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1f80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563152256:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.824603:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:3.0:1777502232.825879:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.825912:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.825978:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.826008:0:259254:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1777502232.826019:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410304 00000100:00100000:3.0:1777502232.826025:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410304 00000100:00100000:3.0:1777502232.826048:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410432 00000100:00100000:3.0:1777502232.826050:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410432 00000100:00100000:3.0:1777502232.826055:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410560 00000100:00100000:3.0:1777502232.826056:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410560 00000100:00100000:3.0:1777502232.826064:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1042 00000100:00100000:3.0:1777502232.826071:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+7:186937:x1863837561410304:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.826081:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.826129:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.826135:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+7:186937:x1863837561410304:12345-192.168.202.127@tcp:104: Request processed in 64us (260us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502232.826150:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1777502232.826153:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1042 00010000:00010000:0.0:1777502232.826156:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826163:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4d600 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.826167:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.826169:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1043 00000100:00100000:3.0:1777502232.826175:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561410432:12345-192.168.202.127@tcp:104: 00010000:00010000:0.0:1777502232.826176:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.826181:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826183:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826202:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1777502232.826215:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.826220:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561410432:12345-192.168.202.127@tcp:104: Request processed in 46us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.826226:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1043 00010000:00010000:0.0:1777502232.826237:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826244:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1777502232.826250:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1044 00010000:00010000:1.0:1777502232.826253:0:263969:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1777502232.826258:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0756dad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561410560:12345-192.168.202.127@tcp:104: 00010000:00010000:1.0:1777502232.826261:0:263969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826263:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.826265:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.826283:0:263969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4da00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.826283:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d600/0xac3ccf43bf834679 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4444 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.826290:0:263969:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.826301:0:263969:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826301:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777502232.826302:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:0.0:1777502232.826306:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000100:00100000:3.0:1777502232.826311:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0756dad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561410560:12345-192.168.202.127@tcp:104: Request processed in 53us (338us total) trans 0 rc 0/0 00010000:00010000:1.0:1777502232.826319:0:263969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826321:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b759800 already unused, calling callback (ffffffffc1caf310) 00000100:00100000:3.0:1777502232.826322:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1044 00010000:00010000:0.0:1777502232.826327:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.826336:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.826351:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.826369:0:263969:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759a00/0xac3ccf43bf8345d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc416c expref: -99 pid: 273074 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.826370:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759a00/0xac3ccf43bf8345d8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc416c expref: -99 pid: 273074 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1777502232.826375:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.826413:0:263969:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826418:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.826423:0:263969:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.826431:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.826435:0:263969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826438:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.826454:0:263969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4da00/0xac3ccf43bf8346aa lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43f7 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.826457:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759800/0xac3ccf43bf834641 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21b:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42f4 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.826471:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.826479:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.826481:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.826489:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.826492:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.826494:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502232.826496:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563152512:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.826509:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563152384:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.826561:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563152640:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.827787:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563152512:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.827790:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563152384:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.827802:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563152640:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.829143:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1f80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563152256:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.829211:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x21b:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.829222:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.829291:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x21b:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.829306:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x21b:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502232.829386:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.829399:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-14, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.829403:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-14, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.829416:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-14,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.829445:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.829452:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.829458:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.829469:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2680 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563152768:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.829505:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.830820:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2680 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563152768:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.830835:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830871:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830878:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830888:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830898:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830909:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830916:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830924:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.830933:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a2680 x1863837563152768/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.830941:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.830965:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.830974:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/535 (0 0) 00000080:00200000:0.0:1777502232.830980:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.831003:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x217:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.831073:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x217:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.831084:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x217:0x0](ffffa0757e5c5b88) for lock 0xac3ccf43bf83473d 00000080:00010000:0.0:1777502232.831093:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x217:0x0](ffffa0757e5c5b88) 00000080:00010000:0.0:1777502232.831096:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83473d from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.831100:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.831108:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.831128:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.831132:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-14, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.831176:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.831189:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x217:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.831210:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.831214:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.831221:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83473d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc48c7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.831251:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.831255:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a2680 x1863837563153024/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.831268:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2680 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563153024:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.831309:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:3.0:1777502232.832469:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.832528:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410688 00000100:00100000:2.0:1777502232.832534:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410688 00000100:00100000:2.0:1777502232.832569:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1045 00000100:00100000:2.0:1777502232.832577:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561410688:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.832590:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1777502232.832660:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777502232.832665:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561410688:12345-192.168.202.127@tcp:104: Request processed in 90us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.832672:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1045 00010000:00010000:1.0:1777502232.832680:0:259773:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.832698:0:259773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.832709:0:259773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07549ab2800 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.832714:0:259773:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.832738:0:259773:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.832748:0:259773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.832765:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00010000:00010000:1.0:1777502232.832773:0:259773:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.832803:0:259773:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.832812:0:259773:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777502232.832835:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410816 00000100:00100000:2.0:1777502232.832839:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410816 00010000:00010000:1.0:1777502232.832851:0:259773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.832860:0:259773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2800/0xac3ccf43bf83465d lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc434f expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.832864:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1046 00000100:00100000:2.0:1777502232.832870:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561410816:12345-192.168.202.127@tcp:104: 00000100:00100000:0.0:1777502232.832887:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563153152:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502232.832889:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.832891:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00010000:00010000:1.0:1777502232.832896:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.832900:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.832906:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777502232.832923:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561410944 00000100:00100000:3.0:1777502232.832928:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561410944 00010000:00010000:2.0:1777502232.832952:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.832961:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1047 00000100:00100000:2.0:1777502232.832962:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:205369:x1863837561410816:12345-192.168.202.127@tcp:104: Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.832973:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+6:205369:x1863837561410944:12345-192.168.202.127@tcp:104: 00000100:00100000:2.0:1777502232.832974:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1046 00010000:00010000:3.0:1777502232.832985:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.833013:0:259263:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777502232.833028:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.833034:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561410944:12345-192.168.202.127@tcp:104: Request processed in 65us (192us total) trans 0 rc 0/0 00010000:00010000:1.0:1777502232.833037:0:259263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.833044:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1047 00010000:00010000:1.0:1777502232.833052:0:259263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b759200 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.833058:0:270435:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.833064:0:259263:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.833066:0:270435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.833085:0:259263:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.833086:0:270435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0756ac86e00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.833092:0:270435:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.833099:0:259263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.833104:0:270435:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.833118:0:270435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.833122:0:259263:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b535e00/0xac3ccf43bf8345a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x217:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc40a8 expref: -99 pid: 273066 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.833139:0:270435:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b535e00/0xac3ccf43bf8345a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x217:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc40a8 expref: -99 pid: 273066 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.833160:0:259263:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.833167:0:259263:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.833172:0:270435:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.833182:0:259263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.833187:0:270435:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.833194:0:259263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759200/0xac3ccf43bf83461e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4237 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.833206:0:270435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.833207:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.833210:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.833213:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.833219:0:270435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86e00/0xac3ccf43bf8345fb lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x217:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41dc expref: -99 pid: 273092 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1777502232.833226:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563153280:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502232.833247:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.833250:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.833252:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.833286:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563153408:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.834447:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563153152:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.834653:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563153280:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.834842:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563153408:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.836225:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2680 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563153024:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.836305:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x217:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.836317:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.836366:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x217:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.836378:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x217:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.836440:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.836452:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-10, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.836455:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-10, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.836468:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-10,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.836512:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.836533:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.836543:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.836557:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563153536:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.836599:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.837969:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563153536:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.837984:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838000:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838007:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838018:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838028:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838038:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838055:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838065:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.838072:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a3b80 x1863837563153536/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.838079:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.838086:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838093:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/531 (0 0) 00000080:00200000:0.0:1777502232.838096:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.838117:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x213:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.838207:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x213:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.838219:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x213:0x0](ffffa0757e5c6c08) for lock 0xac3ccf43bf834744 00000080:00010000:0.0:1777502232.838226:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x213:0x0](ffffa0757e5c6c08) 00000080:00010000:0.0:1777502232.838243:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834744 from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.838247:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.838254:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.838279:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.838284:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-10, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.838321:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.838342:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x213:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.838372:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.838377:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.838379:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834744 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc48ff expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.838394:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.838398:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a3b80 x1863837563153792/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.838413:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563153792:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.838467:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:2.0:1777502232.839915:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.839973:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411072 00000100:00100000:3.0:1777502232.839980:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411072 00000100:00100000:3.0:1777502232.840019:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1048 00000100:00100000:3.0:1777502232.840029:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:188648:x1863837561411072:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.840043:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:3.0:1777502232.840102:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.840108:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:188648:x1863837561411072:12345-192.168.202.127@tcp:104: Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.840114:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1048 00010000:00010000:1.0:1777502232.840134:0:263969:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.840152:0:263969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1777502232.840163:0:263969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0756acf5a00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.840168:0:263969:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1777502232.840177:0:263969:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1777502232.840185:0:263969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1777502232.840202:0:263969:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b535000/0xac3ccf43bf8344f8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x213:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc3f04 expref: -99 pid: 273054 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.840255:0:263969:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1777502232.840260:0:263969:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.840284:0:263969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1777502232.840289:0:263969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5a00/0xac3ccf43bf834537 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x213:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc401c expref: -99 pid: 273075 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1777502232.840298:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.840299:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.840300:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.840313:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563153920:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.841260:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563153920:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.842441:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3b80 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563153792:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.842498:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x213:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.842507:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.842549:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x213:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.842578:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x213:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.842673:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.842688:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.842692:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.842709:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-17,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.842749:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.842759:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.842768:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.842782:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1500 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563154048:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.842826:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.844118:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1500 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563154048:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.844132:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844149:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844156:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844166:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844199:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844210:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844218:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844226:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.844247:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a1500 x1863837563154048/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.844257:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.844269:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844279:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/538 (0 0) 00000080:00200000:0.0:1777502232.844284:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.844311:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x21a:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.844398:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x21a:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.844410:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x21a:0x0](ffffa0757e5c5b88) for lock 0xac3ccf43bf83474b 00000080:00010000:0.0:1777502232.844420:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x21a:0x0](ffffa0757e5c5b88) 00000080:00010000:0.0:1777502232.844427:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83474b from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.844429:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.844435:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.844452:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.844457:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.844485:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.844505:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x21a:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.844551:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.844558:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.844561:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf83474b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4937 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.844583:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.844590:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a1500 x1863837563154304/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.844606:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1500 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563154304:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.844687:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:3.0:1777502232.845894:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.845961:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411200 00000100:00100000:2.0:1777502232.845968:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411200 00000100:00100000:3.0:1777502232.846006:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.846017:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411328 00000100:00100000:2.0:1777502232.846020:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411328 00000100:00100000:3.0:1777502232.846039:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1049 00000100:00100000:2.0:1777502232.846048:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1050 00000100:00100000:2.0:1777502232.846062:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561411328:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.846075:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1777502232.846134:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777502232.846142:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561411328:12345-192.168.202.127@tcp:104: Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.846150:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1050 00000100:00100000:3.0:1777502232.846160:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561411200:12345-192.168.202.127@tcp:104: 00010000:00010000:0.0:1777502232.846160:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.846171:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.846174:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.846197:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00010000:00010000:0.0:1777502232.846220:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4c800 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.846225:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.846243:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.846249:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.846266:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.846273:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561411200:12345-192.168.202.127@tcp:104: Request processed in 226us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.846281:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1049 00000100:00100000:2.0:1777502232.846283:0:259254:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1777502232.846285:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.846291:0:259773:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1777502232.846296:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411456 00010000:00010000:1.0:1777502232.846299:0:259773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.846301:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411456 00010000:00010000:1.0:1777502232.846310:0:259773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4c600 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.846315:0:259773:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.846320:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.846326:0:259773:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.846331:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777502232.846335:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1051 00010000:00010000:1.0:1777502232.846343:0:259773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.846348:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa0754ef05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561411456:12345-192.168.202.127@tcp:104: 00010000:00010000:0.0:1777502232.846351:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.846357:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c800/0xac3ccf43bf8346a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43cd expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.846361:0:259773:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1777502232.846370:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.846379:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.846382:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.846386:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.846394:0:2371:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1777502232.846407:0:259773:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1777502232.846410:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563154432:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502232.846421:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1777502232.846421:0:259773:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777502232.846430:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa0754ef05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561411456:12345-192.168.202.127@tcp:104: Request processed in 84us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1777502232.846433:0:259773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.846438:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1051 00010000:00010000:1.0:1777502232.846447:0:259773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c600/0xac3ccf43bf834672 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4413 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1777502232.846451:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563154560:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777502232.846469:0:259773:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.846473:0:259773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.846487:0:259773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b758200 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.846491:0:259773:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.846496:0:259773:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.846503:0:259773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.846517:0:259773:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac86c00/0xac3ccf43bf8345ca lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc413b expref: -99 pid: 273073 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1777502232.846523:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.846543:0:259773:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.846551:0:259773:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.846575:0:259773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.846584:0:259773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758200/0xac3ccf43bf834633 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21a:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42bc expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:0.0:1777502232.846590:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563154688:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777502232.846597:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.846600:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.846603:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.847905:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563154688:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.847916:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563154560:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.847937:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563154432:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.849186:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1500 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563154304:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.849277:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x21a:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.849287:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.849335:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x21a:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.849349:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x21a:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.849434:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.849448:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-15, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.849453:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-15, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.849469:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-15,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.849520:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.849530:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.849538:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.849554:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3480 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563154816:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.849602:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.850897:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3480 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563154816:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.850921:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.850938:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.850946:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.850956:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.850979:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.850990:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.850997:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.851004:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.851011:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a3480 x1863837563154816/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.851018:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.851031:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.851041:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/536 (0 0) 00000080:00200000:0.0:1777502232.851045:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.851068:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x218:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502232.851155:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x218:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.851165:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x218:0x0](ffffa0757e5c00c8) for lock 0xac3ccf43bf834752 00000080:00010000:0.0:1777502232.851172:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x218:0x0](ffffa0757e5c00c8) 00000080:00010000:0.0:1777502232.851175:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834752 from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.851177:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.851183:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.851199:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.851204:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-15, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.851240:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.851255:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x218:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.851277:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.851282:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.851290:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834752 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc496f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.851313:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.851319:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a3480 x1863837563155072/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.851333:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3480 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563155072:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.851376:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:2.0:1777502232.852993:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.853111:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.853207:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.853240:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411584 00000100:00100000:3.0:1777502232.853249:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411584 00000100:00100000:3.0:1777502232.853291:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411712 00000100:00100000:3.0:1777502232.853294:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411712 00000100:00100000:3.0:1777502232.853308:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1052 00000100:00100000:3.0:1777502232.853316:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:205369:x1863837561411584:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.853330:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.853390:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.853396:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:205369:x1863837561411584:12345-192.168.202.127@tcp:104: Request processed in 82us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.853404:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1052 00010000:00010000:0.0:1777502232.853413:0:270435:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.853419:0:270435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.853425:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1053 00010000:00010000:0.0:1777502232.853432:0:270435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07549ab2000 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.853435:0:270435:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.853437:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561411712:12345-192.168.202.127@tcp:104: 00010000:00010000:0.0:1777502232.853446:0:270435:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.853451:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853453:0:270435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853484:0:270435:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1777502232.853495:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.853505:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561411712:12345-192.168.202.127@tcp:104: Request processed in 66us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502232.853515:0:270435:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.853523:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1053 00010000:00010000:0.0:1777502232.853543:0:270435:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.853565:0:270435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853572:0:270435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab2000/0xac3ccf43bf834664 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43a3 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853588:0:270435:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.853591:0:270435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853599:0:270435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4c000 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.853602:0:270435:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853608:0:270435:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853616:0:270435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853661:0:270435:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.853681:0:270435:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853698:0:270435:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.853707:0:270435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853714:0:270435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c000/0xac3ccf43bf834695 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4348 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.853726:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.853728:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.853730:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.853745:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563155328:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.853782:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563155200:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502232.853812:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777502232.853990:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411840 00000100:00100000:3.0:1777502232.853994:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411840 00000100:00100000:3.0:1777502232.854022:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1054 00000100:00100000:3.0:1777502232.854028:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561411840:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.854036:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1777502232.854074:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.854080:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561411840:12345-192.168.202.127@tcp:104: Request processed in 52us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.854087:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1054 00010000:00010000:0.0:1777502232.854096:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.854101:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.854109:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b758000 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.854112:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.854118:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.854123:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.854142:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759000/0xac3ccf43bf8345ae lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x218:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc40d9 expref: -99 pid: 273069 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.854174:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.854181:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.854203:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.854211:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758000/0xac3ccf43bf834625 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x218:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4253 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1777502232.854222:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563155456:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502232.854223:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.854226:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.854240:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.854910:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563155328:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.854933:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563155200:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.855199:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563155456:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.856581:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3480 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563155072:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.856686:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x218:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.856698:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.856750:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x218:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.856765:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x218:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502232.856864:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.856879:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-06, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.856883:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-06, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.856901:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-06,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.856942:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.856965:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.856976:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.856993:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563155584:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.857044:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.858401:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563155584:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.858416:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858433:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858441:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858450:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858461:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858471:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858492:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858500:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.858511:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a0380 x1863837563155584/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.858521:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.858532:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858542:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/527 (0 0) 00000080:00200000:0.0:1777502232.858546:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.858565:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x20f:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.858652:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x20f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.858660:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x20f:0x0](ffffa0757e5c5b88) for lock 0xac3ccf43bf834759 00000080:00010000:0.0:1777502232.858666:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x20f:0x0](ffffa0757e5c5b88) 00000080:00010000:0.0:1777502232.858669:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834759 from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.858671:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.858677:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.858702:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.858706:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-06, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.858731:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.858744:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x20f:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.858764:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.858768:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.858770:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834759 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc49a7 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.858784:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.858788:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a0380 x1863837563155840/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.858799:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563155840:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.858836:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:2.0:1777502232.860039:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.860082:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561411968 00000100:00100000:3.0:1777502232.860090:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561411968 00000100:00100000:3.0:1777502232.860129:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1055 00000100:00100000:3.0:1777502232.860137:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:188648:x1863837561411968:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.860148:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.860204:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.860211:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:188648:x1863837561411968:12345-192.168.202.127@tcp:104: Request processed in 74us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.860218:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1055 00010000:00010000:1.0:1777502232.860257:0:259263:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.860265:0:259263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.860274:0:259263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757a0d2800 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.860278:0:259263:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.860286:0:259263:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.860294:0:259263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.860313:0:259263:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756acf5200/0xac3ccf43bf834481 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc3c5d expref: -99 pid: 273041 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:1.0:1777502232.860356:0:259263:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.860377:0:259263:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.860403:0:259263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.860411:0:259263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d2800/0xac3ccf43bf834522 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x20f:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc3fc1 expref: -99 pid: 273058 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1777502232.860424:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563155968:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777502232.860425:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.860429:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.860432:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.861371:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563155968:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.862692:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0380 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563155840:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.862762:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x20f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.862773:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.862821:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x20f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.862846:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x20f:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.862922:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.862936:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.862940:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.862957:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-18,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.862994:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.863003:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.863012:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.863028:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1180 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156096:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.863087:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.864683:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1180 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156096:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.864703:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864731:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864742:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864752:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864779:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864789:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864797:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864805:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.864815:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a1180 x1863837563156096/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.864826:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.864837:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.864846:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/533 (0 0) 00000080:00200000:0.0:1777502232.864850:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.864872:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x215:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502232.864967:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x215:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.864978:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x215:0x0](ffffa0757e5c00c8) for lock 0xac3ccf43bf834760 00000080:00010000:0.0:1777502232.864987:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x215:0x0](ffffa0757e5c00c8) 00000080:00010000:0.0:1777502232.864995:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834760 from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.864999:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.865007:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.865029:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.865035:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.865072:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.865092:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x215:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.865125:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.865132:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.865135:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf834760 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc49df expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.865157:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.865163:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a1180 x1863837563156352/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.865179:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1180 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156352:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.865246:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:2.0:1777502232.866471:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.866555:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412096 00000100:00100000:3.0:1777502232.866564:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412096 00000100:00100000:2.0:1777502232.866605:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.866612:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1056 00000100:00100000:2.0:1777502232.866663:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412224 00000100:00100000:2.0:1777502232.866667:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412224 00000100:00100000:3.0:1777502232.866703:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561412096:12345-192.168.202.127@tcp:104: 00000100:00100000:2.0:1777502232.866707:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1057 00010000:00010000:3.0:1777502232.866716:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.866718:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561412224:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.866728:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1777502232.866793:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1777502232.866801:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561412096:12345-192.168.202.127@tcp:104: Request processed in 102us (333us total) trans 0 rc 0/0 00010000:00010000:2.0:1777502232.866802:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1777502232.866814:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1056 00000100:00100000:2.0:1777502232.866814:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561412224:12345-192.168.202.127@tcp:104: Request processed in 96us (207us total) trans 0 rc 0/0 00010000:00010000:1.0:1777502232.866824:0:259773:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1777502232.866825:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1057 00010000:00010000:0.0:1777502232.866826:0:270435:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.866834:0:259773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.866834:0:270435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1777502232.866865:0:270435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0756ac87600 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.866867:0:259773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b758e00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.866870:0:270435:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1777502232.866873:0:259773:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.866885:0:270435:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1777502232.866888:0:259773:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.866901:0:270435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1777502232.866903:0:259773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.866930:0:270435:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758400/0xac3ccf43bf83451b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x215:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc3f90 expref: -99 pid: 273072 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.866933:0:259773:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758400/0xac3ccf43bf83451b lrc: 3/0,0 mode: CR/CR res: [0x200000bd2:0x215:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc3f90 expref: -99 pid: 273072 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.866976:0:270435:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1777502232.866983:0:270435:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.866988:0:259773:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.866996:0:259773:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.867002:0:270435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1777502232.867005:0:259773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.867018:0:270435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87600/0xac3ccf43bf8345ed lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41ce expref: -99 pid: 273086 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 1 00010000:00010000:1.0:1777502232.867021:0:259773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758e00/0xac3ccf43bf83463a lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x215:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc42d8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.867039:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.867042:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.867043:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.867047:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.867047:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.867051:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.867061:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563156608:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.867066:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563156480:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.868190:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563156480:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.868342:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563156608:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.869586:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1180 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156352:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.869701:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x215:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.869710:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.869749:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x215:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.869759:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x215:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502232.869842:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.869855:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-12, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.869858:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-12, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.869883:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-12,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.869926:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.869936:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.869946:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.869961:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2a00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156736:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.870006:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.871711:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2a00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156736:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.871728:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871746:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871765:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871775:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871795:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871806:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871814:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871822:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.871832:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a2a00 x1863837563156736/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.871843:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.871855:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.871875:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/534 (0 0) 00000080:00200000:0.0:1777502232.871880:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.871908:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x216:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.872004:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x216:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.872015:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x216:0x0](ffffa0757e5c6c08) for lock 0xac3ccf43bf834767 00000080:00010000:0.0:1777502232.872024:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x216:0x0](ffffa0757e5c6c08) 00000080:00010000:0.0:1777502232.872027:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834767 from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.872030:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.872038:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.872060:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.872066:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-12, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.872102:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.872121:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x216:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.872151:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.872158:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.872161:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfc00/0xac3ccf43bf834767 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4a17 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.872193:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.872205:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a2a00 x1863837563156992/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.872223:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2a00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156992:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.872288:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:3.0:1777502232.873511:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.873573:0:259919:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1777502232.873587:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412352 00000100:00100000:2.0:1777502232.873593:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412352 00000100:00100000:2.0:1777502232.873662:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1058 00000100:00100000:2.0:1777502232.873670:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07549a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561412352:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.873680:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1777502232.873725:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777502232.873729:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07549a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561412352:12345-192.168.202.127@tcp:104: Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.873735:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1058 00010000:00010000:0.0:1777502232.873751:0:263969:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.873758:0:263969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.873768:0:263969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b759400 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.873772:0:263969:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.873780:0:263969:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.873788:0:263969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.873807:0:263969:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a247e00/0xac3ccf43bf834576 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x216:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4054 expref: -99 pid: 273061 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.873847:0:263969:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.873854:0:263969:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.873882:0:263969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.873903:0:263969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759400/0xac3ccf43bf834609 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x216:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc41f8 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1777502232.873905:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157120:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502232.873920:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.873923:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.873925:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502232.875049:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157120:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.876287:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2a00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563156992:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.876352:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x216:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.876362:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.876413:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x216:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.876427:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x216:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.876500:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.876514:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.876519:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.876537:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-20,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.876576:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.876586:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.876594:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.876611:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1c00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563157248:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.876682:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.878068:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1c00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563157248:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.878084:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878102:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878115:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878125:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878136:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878147:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878154:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878162:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.878169:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a1c00 x1863837563157248/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.878176:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.878192:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878199:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/540 (0 0) 00000080:00200000:0.0:1777502232.878204:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.878225:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x21c:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.878327:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x21c:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.878336:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x21c:0x0](ffffa0757e5c5b88) for lock 0xac3ccf43bf83476e 00000080:00010000:0.0:1777502232.878343:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x21c:0x0](ffffa0757e5c5b88) 00000080:00010000:0.0:1777502232.878346:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83476e from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.878348:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.878354:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.878372:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.878377:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.878401:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.878414:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x21c:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.878437:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.878441:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.878447:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83476e lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4a4f expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.878463:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.878468:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a1c00 x1863837563157504/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.878481:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1c00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563157504:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.878520:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:3.0:1777502232.879706:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.879760:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412480 00000100:00100000:3.0:1777502232.879763:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.879770:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412480 00000100:00100000:2.0:1777502232.879808:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412608 00000100:00100000:2.0:1777502232.879811:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412608 00000100:00100000:2.0:1777502232.879827:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1059 00000100:00100000:2.0:1777502232.879835:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+6:205372:x1863837561412480:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.879847:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1777502232.879894:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777502232.879901:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+6:205372:x1863837561412480:12345-192.168.202.127@tcp:104: Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.879908:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1059 00010000:00010000:0.0:1777502232.879917:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.879922:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.879930:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b758c00 already unused, calling callback (ffffffffc1caf310) 00000100:00100000:3.0:1777502232.879932:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1060 00010000:00010000:0.0:1777502232.879935:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.879945:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:205372:x1863837561412608:12345-192.168.202.127@tcp:104: 00010000:00010000:0.0:1777502232.879946:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.879960:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.879960:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.879971:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00010000:00010000:0.0:1777502232.879993:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.880028:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.880045:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412736 00010000:00010000:0.0:1777502232.880045:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777502232.880048:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412736 00000100:00100000:2.0:1777502232.880065:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1061 00000100:00100000:2.0:1777502232.880071:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+6:205372:x1863837561412736:12345-192.168.202.127@tcp:104: 00010000:00010000:0.0:1777502232.880073:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.880080:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758c00/0xac3ccf43bf83470c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc47f5 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1777502232.880084:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.880093:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.880096:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.880102:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4d800 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.880105:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.880112:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.880119:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.880131:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000100:00100000:1.0:1777502232.880138:0:2371:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777502232.880149:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157632:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502232.880151:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.880169:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.880178:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1777502232.880181:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157760:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502232.880192:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d800/0xac3ccf43bf8346b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4475 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.880203:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.880206:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.880212:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4c200 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.880215:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.880221:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1777502232.880223:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1777502232.880239:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+6:205372:x1863837561412736:12345-192.168.202.127@tcp:104: Request processed in 158us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502232.880239:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00000100:00100000:2.0:1777502232.880246:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1061 00010000:00010000:0.0:1777502232.880252:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b759600/0xac3ccf43bf8345e6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc418f expref: -99 pid: 273078 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1777502232.880262:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.880273:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.880291:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.880298:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.880306:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4c200/0xac3ccf43bf834680 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x21c:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4460 expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.880315:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.880317:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.880318:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.880337:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502232.880419:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1777502232.880425:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:205372:x1863837561412608:12345-192.168.202.127@tcp:104: Request processed in 485us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.880430:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1060 00000100:00100000:1.0:1777502232.880473:0:2371:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777502232.880484:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157888:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.881674:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157760:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.881701:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157632:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.881715:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563157888:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.882956:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1c00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563157504:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.883039:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x21c:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.883048:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.883089:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x21c:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.883109:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x21c:0x0](ffffa0757e5c5b88) 00000080:00200000:0.0:1777502232.883192:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.883207:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-16, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.883211:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-16, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.883239:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-16,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.883275:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.883285:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.883294:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.883322:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1880 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563158016:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.883369:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.884680:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1880 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563158016:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.884692:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884741:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884749:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884759:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884770:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884779:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884784:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884789:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.884807:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a1880 x1863837563158016/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.884814:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.884825:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884834:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/537 (0 0) 00000080:00200000:0.0:1777502232.884839:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.884863:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x219:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.884931:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x219:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.884938:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x219:0x0](ffffa0757e5c6c08) for lock 0xac3ccf43bf834775 00000080:00010000:0.0:1777502232.884944:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x219:0x0](ffffa0757e5c6c08) 00000080:00010000:0.0:1777502232.884946:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834775 from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.884948:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.884954:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.884977:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.884983:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-16, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.885019:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.885045:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x219:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.885074:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.885080:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.885084:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf000/0xac3ccf43bf834775 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4a87 expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.885113:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.885120:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a1880 x1863837563158272/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.885135:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a1880 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563158272:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.885177:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:2.0:1777502232.886348:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.886385:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412864 00000100:00100000:2.0:1777502232.886390:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.886393:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412864 00000100:00100000:2.0:1777502232.886408:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561412992 00000100:00100000:2.0:1777502232.886411:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561412992 00000100:00100000:2.0:1777502232.886434:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1062 00000100:00100000:2.0:1777502232.886441:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561412864:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.886450:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1777502232.886498:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777502232.886505:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:0775d2ab-558e-41f1-82c0-14244d133390+6:186937:x1863837561412864:12345-192.168.202.127@tcp:104: Request processed in 64us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.886513:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1062 00000100:00100000:3.0:1777502232.886521:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1063 00000100:00100000:3.0:1777502232.886531:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561412992:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.886541:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886543:0:259773:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.886553:0:259773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.886571:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00010000:00010000:1.0:1777502232.886571:0:259773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07549ab3400 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.886578:0:259773:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886588:0:259773:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886595:0:259773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886613:0:259773:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1777502232.886615:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.886650:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561412992:12345-192.168.202.127@tcp:104: Request processed in 97us (235us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502232.886654:0:263969:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1777502232.886659:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1063 00010000:00010000:0.0:1777502232.886661:0:263969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.886668:0:263969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571f4d400 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.886672:0:263969:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886673:0:259773:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:3.0:1777502232.886677:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561413120 00000100:00100000:3.0:1777502232.886682:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561413120 00010000:00010000:0.0:1777502232.886689:0:263969:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886690:0:259773:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.886700:0:263969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886711:0:259773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 6 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:1.0:1777502232.886732:0:259773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07549ab3400/0xac3ccf43bf83466b lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 5 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc43db expref: -99 pid: 273098 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.886739:0:263969:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:1.0:1777502232.886765:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.886767:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.886769:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502232.886783:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563158400:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777502232.886785:0:263969:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.886793:0:263969:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777502232.886803:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1064 00010000:00010000:0.0:1777502232.886804:0:263969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.886812:0:263969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571f4d400/0xac3ccf43bf83469c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 4 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4387 expref: -99 pid: 273096 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1777502232.886817:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561413120:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.886831:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00000100:00100000:1.0:1777502232.886833:0:2371:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1777502232.886833:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.886838:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.886842:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502232.886845:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563158528:192.168.202.127@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777502232.886895:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777502232.886901:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+5:186937:x1863837561413120:12345-192.168.202.127@tcp:104: Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.886906:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1064 00010000:00010000:0.0:1777502232.886915:0:270435:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.886921:0:270435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.886929:0:270435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757b758a00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.886933:0:270435:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.886940:0:270435:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.886957:0:270435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.886968:0:270435:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b534600/0xac3ccf43bf8345bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x219:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc410a expref: -99 pid: 273070 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.886989:0:270435:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.886995:0:270435:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.887017:0:270435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.887025:0:270435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757b758a00/0xac3ccf43bf83462c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x219:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4284 expref: -99 pid: 273097 timeout: 0 lvb_type: 3 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502232.887036:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.887037:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.887039:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.887045:0:2370:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777502232.887054:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563158656:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.887885:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563158528:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.887897:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563158400:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.888027:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563158656:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.889107:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a1880 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563158272:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.889172:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x219:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.889182:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.889248:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x219:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.889261:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x219:0x0](ffffa0757e5c6c08) 00000080:00200000:0.0:1777502232.889333:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.889346:0:274351:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-08, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags=0 00000080:00200000:0.0:1777502232.889350:0:274351:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-08, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), intent=getattr 00000002:00010000:0.0:1777502232.889367:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-08,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.889401:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.889411:0:274351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.889419:0:274351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 274351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502232.889434:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563158784:192.168.202.127@tcp:101:rm.0 00000100:00100000:0.0:1777502232.889479:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:0.0:1777502232.890959:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563158784:192.168.202.127@tcp:101:rm.0 00010000:00010000:0.0:1777502232.890982:0:274351:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891001:0:274351:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891007:0:274351:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 4/1,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891014:0:274351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891031:0:274351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891039:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891045:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 5/2,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891050:0:274351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 4/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502232.891056:0:274351:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a0e00 x1863837563158784/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/640 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502232.891066:0:274351:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502232.891076:0:274351:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891086:0:274351:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589937618/528 (0 0) 00000080:00200000:0.0:1777502232.891091:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1777502232.891115:0:274351:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd2:0x210:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502232.891196:0:274351:0:(file.c:6767:ll_layout_conf()) [0x200000bd2:0x210:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1777502232.891207:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000bd2:0x210:0x0](ffffa0757e5c00c8) for lock 0xac3ccf43bf83477c 00000080:00010000:0.0:1777502232.891216:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000bd2:0x210:0x0](ffffa0757e5c00c8) 00000080:00010000:0.0:1777502232.891240:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf83477c from it ffffbd7f44853df8 00010000:00010000:0.0:1777502232.891244:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 3/1,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502232.891253:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.891275:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.891280:0:274351:0:(namei.c:2402:ll_unlink()) VFS Op:name=f77r.sanityn-08, dir=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502232.891319:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502232.891339:0:274351:0:(vvp_object.c:117:vvp_conf_set()) [0x200000bd2:0x210:0x0]: losing layout lock 00010000:00010000:0.0:1777502232.891370:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502232.891375:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.891378:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edf600/0xac3ccf43bf83477c lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4ad31463d9bc4abf expref: -99 pid: 274351 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1777502232.891393:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.891398:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a0e00 x1863837563159040/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.891410:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563159040:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.891454:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463070c0 going to sleep for 176 seconds 00000100:00100000:2.0:1777502232.892796:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.892855:0:259254:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1777502232.892869:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561413248 00000100:00100000:3.0:1777502232.892876:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561413248 00000100:00100000:3.0:1777502232.892918:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1065 00000100:00100000:3.0:1777502232.892928:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07549a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561413248:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.892941:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502232.892999:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.893006:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07549a3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:205369:x1863837561413248:12345-192.168.202.127@tcp:104: Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.893014:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1065 00010000:00010000:0.0:1777502232.893026:0:259262:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.893033:0:259262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.893056:0:259262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757a0d3c00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.893062:0:259262:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.893071:0:259262:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 2/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.893080:0:259262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 3/0,0 mode: PR/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.893100:0:259262:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571e82800/0xac3ccf43bf8344b2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd2:0x210:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x4ad31463d9bc3d28 expref: -99 pid: 273048 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502232.893141:0:259262:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 2/0,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.893153:0:259262:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.893173:0:259262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 1/0,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.893181:0:259262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a0d3c00/0xac3ccf43bf834529 lrc: 0/0,0 mode: --/PR res: [0x200000bd2:0x210:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x4ad31463d9bc4007 expref: -99 pid: 273064 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.893191:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.893192:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.893195:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502232.893205:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563159168:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.894398:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563159168:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.895413:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0e00 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563159040:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.895480:0:274351:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x210:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1777502232.895490:0:274351:0:(lov_io.c:886:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1777502232.895540:0:274351:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x210:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1777502232.895556:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd2:0x210:0x0](ffffa0757e5c00c8) 00000080:00200008:0.0:1777502232.895661:0:274351:0:(file.c:448:ll_file_release()) START file d77r.sanityn:[0x200000bd1:0x20:0x0](ffffa0755fdc0908), flags 704000 00010000:00010000:0.0:1777502232.895683:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1777502232.895718:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502232.895728:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.895736:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.895745:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.895752:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502232.895756:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502232.895760:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf82aefd 00000080:00010000:0.0:1777502232.895766:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf82aefd from it ffffbd7f44853c10 00010000:00010000:0.0:1777502232.895769:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.895785:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.895801:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502232.895809:0:274351:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=0 00000080:00200000:0.0:1777502232.895817:0:274351:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502232.895822:0:274351:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502232.895827:0:274351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.895832:0:274351:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.895836:0:274351:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502232.895838:0:274351:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502232.895840:0:274351:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf82aefd 00000080:00010000:0.0:1777502232.895842:0:274351:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf82aefd from it ffffbd7f44853d88 00010000:00010000:0.0:1777502232.895844:0:274351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.895848:0:274351:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1777502232.895854:0:274351:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 3 00000080:00200000:0.0:1777502232.895858:0:274351:0:(namei.c:2312:ll_rmdir()) VFS Op:name=d77r.sanityn, dir=[0x200000007:0x1:0x0](ffffa0756f8b0908) 00010000:00010000:0.0:1777502232.895879:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.895893:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1777502232.895918:0:274351:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffffa075490a0a80 x1863837563151104/t8589939068(8589939068) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1777502232.895933:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1777502232.895938:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a0000 x1863837563159424/t0(0) o35->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1777502232.895955:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0000 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563159424:192.168.202.127@tcp:35:rm.0 00000100:00100000:0.0:1777502232.896001:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777502232.896869:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0000 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563159424:192.168.202.127@tcp:35:rm.0 00000002:00100000:0.0:1777502232.896884:0:274351:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffffa075490a0a80 x1863837563151104/t8589939068(8589939068) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 648/608 e 0 to 0 dl 1777502413 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1777502232.896910:0:274351:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075453b2000/0xac3ccf43bf82af0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x4ad31463d9ba1015 expref: -99 pid: 269421 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.896941:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 1/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.896949:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075453b2000/0xac3ccf43bf82af0b lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9ba1015 expref: -99 pid: 269421 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.896955:0:274351:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.896961:0:274351:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1777502232.896964:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede600/0xac3ccf43bf834728 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9bc4834 expref: -99 pid: 274351 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.896973:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075453b2000/0xac3ccf43bf82af0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9ba1015 expref: -99 pid: 269421 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502232.896998:0:274351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa075498fba00/0xac3ccf43bf82aefd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9ba0fd6 expref: -99 pid: 269408 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00100000:0.0:1777502232.897013:0:274351:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502232.897018:0:274351:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a0000 x1863837563159680/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502232.897031:0:274351:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0000 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563159680:192.168.202.127@tcp:36:rm.0 00000100:00100000:0.0:1777502232.897071:0:274351:0:(client.c:2691:ptlrpc_set_wait()) set ffffa075463079c0 going to sleep for 176 seconds 00000100:00100000:3.0:1777502232.898031:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502232.898072:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561413376 00000100:00100000:2.0:1777502232.898078:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561413376 00000100:00100000:2.0:1777502232.898120:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1066 00000100:00100000:2.0:1777502232.898129:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+5:186936:x1863837561413376:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502232.898142:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1777502232.898197:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777502232.898204:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:0775d2ab-558e-41f1-82c0-14244d133390+5:186936:x1863837561413376:12345-192.168.202.127@tcp:104: Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1777502232.898210:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1066 00010000:00010000:0.0:1777502232.898223:0:259263:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777502232.898241:0:259263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.898250:0:259263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571dd9e00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502232.898255:0:259263:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.898263:0:259263:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.898269:0:259263:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.898297:0:259263:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.898301:0:259263:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502232.898328:0:259263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.898333:0:259263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9e00/0xac3ccf43bf82b10a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x4ad31463d9ba1700 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1777502232.898342:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.898343:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502232.898344:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502232.898365:0:2370:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777502232.898379:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563159808:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1777502232.899257:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563159808:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1777502232.899821:0:2364:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502232.899876:0:259254:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561413504 00000100:00100000:3.0:1777502232.899882:0:259254:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561413504 00000100:00100000:3.0:1777502232.899918:0:259254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1067 00000100:00100000:3.0:1777502232.899926:0:259254:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa07571e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:186936:x1863837561413504:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502232.899937:0:259254:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1777502232.899996:0:259254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777502232.900002:0:259254:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa07571e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:0775d2ab-558e-41f1-82c0-14244d133390+5:186936:x1863837561413504:12345-192.168.202.127@tcp:104: Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502232.900009:0:259254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1067 00010000:00010000:1.0:1777502232.900030:0:259773:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502232.900035:0:259773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502232.900042:0:259773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07571dd9600 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:1.0:1777502232.900045:0:259773:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502232.900059:0:259773:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502232.900065:0:259773:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502232.900090:0:259773:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502232.900103:0:259773:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502232.900121:0:259773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 1/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502232.900126:0:259773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07571dd9600/0xac3ccf43bf82b12d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x20:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x4ad31463d9ba1738 expref: -99 pid: 269482 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502232.900134:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.900135:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502232.900136:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777502232.900145:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563159936:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.901027:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563159936:192.168.202.127@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1777502232.903873:0:274351:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0000 pname:cluuid:pid:xid:nid:opc:job rm:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274351:1863837563159680:192.168.202.127@tcp:36:rm.0 00000080:00200000:0.0:1777502232.903925:0:274351:0:(llite_lib.c:1917:ll_clear_inode()) VFS Op:inode=[0x200000bd1:0x20:0x0](ffffa0755fdc0908) 00010000:00010000:0.0:1777502233.103876:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502234.127786:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502235.151756:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502236.175831:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777502236.399467:0:274621:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77s: Check TBF LRU shrinker ============== 18:37:15 (1777502235) 00000080:00200000:0.0:1777502236.492864:0:274636:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502236.492885:0:274636:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502236.492934:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.492945:0:274636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.492956:0:274636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502236.492982:0:274636:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job lfs:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274636:1863837563160064:192.168.202.127@tcp:101:lfs.0 00000100:00100000:0.0:1777502236.493072:0:274636:0:(client.c:2691:ptlrpc_set_wait()) set ffffa07546307d80 going to sleep for 176 seconds 00000100:00100000:0.0:1777502236.496695:0:274636:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job lfs:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274636:1863837563160064:192.168.202.127@tcp:101:lfs.0 00010000:00010000:0.0:1777502236.496721:0:274636:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496732:0:274636:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496743:0:274636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496753:0:274636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496763:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496770:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496777:0:274636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502236.496787:0:274636:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffffa075490a2300 x1863837563160064/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 576/688 e 0 to 0 dl 1777502417 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1777502236.496799:0:274636:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496838:0:274636:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffffa07547f9d800 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1777502236.496844:0:274636:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1777502236.496867:0:274636:0:(llite_lib.c:2945:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 71168 00000080:00010000:0.0:1777502236.496872:0:274636:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf834783 00000080:00010000:0.0:1777502236.496876:0:274636:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502236.496878:0:274636:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834783 from it ffffbd7f41f7bb58 00010000:00010000:0.0:1777502236.496880:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496886:0:274636:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502236.496903:0:274636:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502236.496915:0:274636:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=d77s.sanityn, dir=[0x200000007:0x1:0x0](ffffa0756f8b0908), flags=13 00000080:00200000:0.0:1777502236.496918:0:274636:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=d77s.sanityn, dir=[0x200000007:0x1:0x0](ffffa0756f8b0908), intent=getattr 00000002:00010000:0.0:1777502236.496930:0:274636:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d77s.sanityn,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502236.496952:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496957:0:274636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.496962:0:274636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502236.496975:0:274636:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job lfs:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274636:1863837563160192:192.168.202.127@tcp:101:lfs.0 00000100:00100000:0.0:1777502236.497025:0:274636:0:(client.c:2691:ptlrpc_set_wait()) set ffffa07546307d80 going to sleep for 176 seconds 00000100:00100000:0.0:1777502236.502740:0:274636:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job lfs:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274636:1863837563160192:192.168.202.127@tcp:101:lfs.0 00010000:00010000:0.0:1777502236.502756:0:274636:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502765:0:274636:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502771:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502775:0:274636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502781:0:274636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502784:0:274636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07579edfa00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502236.502787:0:274636:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502791:0:274636:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502796:0:274636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502800:0:274636:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777502236.502803:0:274636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502236.502807:0:274636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579edfa00/0xac3ccf43bf83478a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 274636 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502236.502832:0:274636:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffffa075490a2300 x1863837563160192/t0(0) o101->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502417 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1777502236.502842:0:274636:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1777502236.502862:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502236.502871:0:274636:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1777502236.502877:0:274636:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834783 from it ffffbd7f41f7b930 00010000:00010000:0.0:1777502236.502879:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502236.502885:0:274636:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1777502236.502943:0:274636:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502236.502951:0:274636:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502236.502955:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502236.502959:0:274636:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1777502236.502963:0:274636:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502236.502965:0:274636:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502236.502967:0:274636:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf834783 00000080:00010000:0.0:1777502236.502974:0:274636:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834783 from it ffffbd7f41f7bbe8 00010000:00010000:0.0:1777502236.502976:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1777502236.502981:0:274636:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1777502236.502986:0:274636:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 1 00000080:00200000:0.0:1777502236.502991:0:274636:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77s.sanityn, flags=16392 00000080:00200008:0.0:1777502236.503019:0:274636:0:(file.c:6227:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffffa0756f8b0908), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1777502236.503023:0:274636:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502236.503027:0:274636:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502236.503031:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502236.503036:0:274636:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1777502236.503041:0:274636:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502236.503044:0:274636:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502236.503046:0:274636:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf834783 00000080:00010000:0.0:1777502236.503049:0:274636:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834783 from it ffffbd7f41f7bcb8 00010000:00010000:0.0:1777502236.503052:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502236.503058:0:274636:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1777502236.503524:0:274636:0:(file.c:6227:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffffa0756f8b0908), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1777502236.503528:0:274636:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502236.503533:0:274636:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502236.503539:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502236.503548:0:274636:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1777502236.503555:0:274636:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502236.503560:0:274636:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502236.503562:0:274636:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf834783 00000080:00010000:0.0:1777502236.503565:0:274636:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834783 from it ffffbd7f41f7bcb8 00010000:00010000:0.0:1777502236.503568:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502236.503575:0:274636:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1777502236.503705:0:274636:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908),name=/ 00000002:00010000:0.0:1777502236.503711:0:274636:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502236.503716:0:274636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1777502236.503721:0:274636:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 1 00000080:00200000:0.0:1777502236.503732:0:274636:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1777502236.503735:0:274636:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) 00000080:00010000:0.0:1777502236.503737:0:274636:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b0908) for lock 0xac3ccf43bf834783 00000080:00010000:0.0:1777502236.503739:0:274636:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf834783 from it ffffbd7f41f7bbb0 00010000:00010000:0.0:1777502236.503741:0:274636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 1 00010000:00010000:0.0:1777502236.503745:0:274636:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1777502236.503750:0:274636:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908), inode mode 41ff mask 44 00000080:00200008:0.0:1777502236.503754:0:274636:0:(file.c:1058:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffffa0756f8b0908), flags 300000 00000080:00200080:0.0:1777502236.503766:0:274636:0:(dir.c:1998:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908) cmd=c03066f0 arg=7ffeac415880 00000080:00200000:0.0:1777502236.503775:0:274636:0:(dir.c:450:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b0908) name=d77s.sanityn stripe_offset=0 stripe_count=1, hash_type=0 00010000:00010000:0.0:1777502236.503791:0:274636:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1777502236.503824:0:274636:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1777502236.503829:0:274636:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502236.503830:0:274636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa0756dba6800 lock: ffffa07579ede800/0xac3ccf43bf834783 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4ad31463d9bc4afe expref: -99 pid: 274636 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000020:00100000:0.0:1777502236.503843:0:274636:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffffa0756dba6800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1777502236.503848:0:274636:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffffa075490a2300 x1863837563160448/t0(0) o36->lustre-MDT0000-mdc-ffffa0756dba6800@192.168.202.127@tcp:12/10 lens 560/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777502236.503869:0:274636:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job lfs:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274636:1863837563160448:192.168.202.127@tcp:36:lfs.0 00000100:00100000:0.0:1777502236.503916:0:274636:0:(client.c:2691:ptlrpc_set_wait()) set ffffa07546307d80 going to sleep for 176 seconds 00000100:00100000:0.0:1777502236.509014:0:274636:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2300 pname:cluuid:pid:xid:nid:opc:job lfs:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:274636:1863837563160448:192.168.202.127@tcp:36:lfs.0 00000080:00200000:0.0:1777502236.509174:0:274636:0:(llite_lib.c:3182:ll_read_inode2()) VFS Op:inode=[0x200000bd1:0x23d:0x0](ffffa0757e5c00c8) 00000080:00200000:0.0:1777502236.509181:0:274636:0:(llite_lib.c:2945:ll_update_inode()) inode=[0x200000bd1:0x23d:0x0], updating i_size 512 00000080:00200008:0.0:1777502236.509217:0:274636:0:(file.c:448:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffffa0756f8b0908), flags 300000 00000100:00100000:1.0:1777502236.815811:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3865704-aa9b-444e-8420-b5af90b3c217:2371:1863837563160576:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502236.815837:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:2370:1863837563160704:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502236.815914:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563160960:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502236.815924:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa075490a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563160832:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502236.815963:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07571f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563161088:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502236.818252:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4254d622-1c5a-45a0-aa2f-9afde5f83f6d:2370:1863837563160704:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502236.818271:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563160832:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0:1777502236.818273:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563160960:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502236.818300:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07571f2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563161088:192.168.202.127@tcp:400:kworker.0 00000100:00100000:1.0:1777502236.818306:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa075490a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c3865704-aa9b-444e-8420-b5af90b3c217:2371:1863837563160576:192.168.202.127@tcp:400:kworker.0 00010000:00010000:1.0:1777502237.199818:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777502237.287896:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:3.0:1777502237.287935:0:2365:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.127@tcp (source: 12345-192.168.202.127@tcp) 00000100:00100000:2.0:1777502237.287980:0:259919:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561414912 00000100:00100000:3.0:1777502237.287982:0:259255:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837561415040 00000100:00100000:3.0:1777502237.287990:0:259255:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561415040 00000100:00100000:2.0:1777502237.287991:0:259919:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837561414912 00000100:00100000:3.0:1777502237.288041:0:259255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1068 00000100:00100000:2.0:1777502237.288051:0:259919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.127@tcp, seq: 1069 00000100:00100000:3.0:1777502237.288053:0:259255:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:205375:x1863837561415040:12345-192.168.202.127@tcp:104: 00010000:00010000:3.0:1777502237.288070:0:259255:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0000-osc-ffffa07549afe000 lock: 000000001fabfe36/0xac3ccf43bf8346c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x4ad31463d9bc446e expref: -99 pid: 273082 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1777502237.288077:0:259919:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffffa075751ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:205383:x1863837561414912:12345-192.168.202.127@tcp:104: 00010000:00010000:2.0:1777502237.288090:0:259919:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-OST0001-osc-ffffa07549afe000 lock: 000000007b282b0c/0xac3ccf43bf8346e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x4ad31463d9bc44a6 expref: -99 pid: 273099 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1777502237.288149:0:259255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1777502237.288155:0:259255:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:LOV_OSC_UUID+4:205375:x1863837561415040:12345-192.168.202.127@tcp:104: Request processed in 107us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1777502237.288162:0:259255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1068 00010000:00010000:2.0:1777502237.288165:0:259919:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1777502237.288198:0:259919:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffffa075751ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:LOV_OSC_UUID+4:205383:x1863837561414912:12345-192.168.202.127@tcp:104: Request processed in 124us (297us total) trans 0 rc 0/0 00010000:00010000:0.0:1777502237.288203:0:263969:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1777502237.288209:0:259919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.127@tcp, seq: 1069 00010000:00010000:0.0:1777502237.288212:0:263969:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffffa07549afe000 lock: 000000001fabfe36/0xac3ccf43bf8346c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420000010000 nid: local remote: 0x4ad31463d9bc446e expref: -99 pid: 273082 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502237.288215:0:270435:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777502237.288222:0:270435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffffa07549afe000 lock: 000000007b282b0c/0xac3ccf43bf8346e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0x4ad31463d9bc44a6 expref: -99 pid: 273099 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502237.288226:0:263969:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0756ac87800 already unused, calling callback (ffffffffc134e220) 00010000:00010000:0.0:1777502237.288234:0:263969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffffa07549afe000 lock: 000000001fabfe36/0xac3ccf43bf8346c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428400010000 nid: local remote: 0x4ad31463d9bc446e expref: -99 pid: 273082 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502237.288235:0:270435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757a247800 already unused, calling callback (ffffffffc134e220) 00010000:00010000:1.0:1777502237.288247:0:270435:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffffa07549afe000 lock: 000000007b282b0c/0xac3ccf43bf8346e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0x4ad31463d9bc44a6 expref: -99 pid: 273099 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502237.288307:0:263969:0:(vvp_io.c:1816:vvp_io_init()) [0x200000bd2:0x214:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1777502237.288320:0:263969:0:(vvp_io.c:287:vvp_io_fini()) [0x200000bd2:0x214:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1 00010000:00010000:1.0:1777502237.288339:0:270435:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffffa07549afe000 lock: 000000007b282b0c/0xac3ccf43bf8346e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x4ad31463d9bc44a6 expref: -99 pid: 273099 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502237.288348:0:270435:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777502237.288371:0:270435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffffa07549afe000 lock: 000000007b282b0c/0xac3ccf43bf8346e2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x4ad31463d9bc44a6 expref: -99 pid: 273099 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502237.288373:0:263969:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffffa07549afe000 lock: 000000001fabfe36/0xac3ccf43bf8346c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x4ad31463d9bc446e expref: -99 pid: 273082 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502237.288389:0:270435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffffa07549afe000 lock: 000000007b282b0c/0xac3ccf43bf8346e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x107c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0x4ad31463d9bc44a6 expref: -99 pid: 273099 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502237.288405:0:263969:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777502237.288415:0:263969:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffffa07549afe000 lock: 000000001fabfe36/0xac3ccf43bf8346c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x4ad31463d9bc446e expref: -99 pid: 273082 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1777502237.288416:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502237.288420:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777502237.288422:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502237.288428:0:263969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffffa07549afe000 lock: 000000001fabfe36/0xac3ccf43bf8346c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x109d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69400010020 nid: local remote: 0x4ad31463d9bc446e expref: -99 pid: 273082 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1777502237.288448:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502237.288450:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502237.288452:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777502237.288455:0:2371:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07571f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563161344:192.168.202.127@tcp:103: 00000100:00100000:0.0:1777502237.288469:0:2370:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07579c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563161216:192.168.202.127@tcp:103: 00000100:00100000:1.0:1777502237.291705:0:2371:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07571f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0775d2ab-558e-41f1-82c0-14244d133390:2371:1863837563161344:192.168.202.127@tcp:103: 00000100:00100000:0.0:1777502237.291705:0:2370:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07579c8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0775d2ab-558e-41f1-82c0-14244d133390:2370:1863837563161216:192.168.202.127@tcp:103: 00000001:02000400:3.0:1777502238.168769:0:274795:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_77s: @@@@@@ FAIL: fail to start 'tbf jobid' policy 00010000:00010000:0.0:1777502238.224128:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1662 lines, 1662 kept, 0 dropped, 0 bad.