00010000:00010000:3.0F:1782107098.173933:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1782107099.197443:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0F:1782107099.479212:0:26851:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:0.0:1782107099.479244:0:26851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107099.479303:0:26851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.479314:0:26851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.479323:0:26851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107099.479348:0:26851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d44383800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:26851:1868674246958336:192.168.203.143@tcp:101:rm.0 00000100:00100000:0.0:1782107099.479555:0:26851:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51516d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782107099.482906:0:26851:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d44383800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:26851:1868674246958336:192.168.203.143@tcp:101:rm.0 00010000:00010000:0.0:1782107099.482928:0:26851:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.482942:0:26851:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.482953:0:26851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.482964:0:26851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.482975:0:26851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.482984:0:26851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.482998:0:26851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782107099.483010:0:26851:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d44383800 x1868674246958336/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107115 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782107099.483024:0:26851:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.483035:0:26851:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1782107099.483040:0:26851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1782107099.483076:0:26851:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1782107099.483082:0:26851:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3d20 00000080:00010000:0.0:1782107099.483086:0:26851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:0.0:1782107099.483089:0:26851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d20 from it ffffb79701dbbb58 00010000:00010000:0.0:1782107099.483092:0:26851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.483099:0:26851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782107099.483122:0:26851:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:0.0:1782107099.483137:0:26851:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), flags=8 00000080:00200000:0.0:1782107099.483141:0:26851:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=getattr 00000002:00010000:0.0:1782107099.483157:0:26851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6d.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107099.483190:0:26851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 26851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.483208:0:26851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.483217:0:26851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107099.483235:0:26851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d44383800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:26851:1868674246958464:192.168.203.143@tcp:101:rm.0 00000100:00100000:0.0:1782107099.483385:0:26851:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51516d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782107099.486082:0:26851:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d44383800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:26851:1868674246958464:192.168.203.143@tcp:101:rm.0 00010000:00010000:0.0:1782107099.486103:0:26851:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486124:0:26851:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486134:0:26851:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486144:0:26851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486154:0:26851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486166:0:26851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486187:0:26851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486195:0:26851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782107099.486206:0:26851:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d44383800 x1868674246958464/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107115 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782107099.486220:0:26851:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486230:0:26851:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589935618/15 (0 0) 00000080:00200000:0.0:1782107099.486236:0:26851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782107099.486255:0:26851:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xf:0x0], updating i_size 0 00000080:00200000:0.0:1782107099.486258:0:26851:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0xf:0x0](ffff935d48d1aa08): rc = 0 00000080:00200000:0.0:1782107099.486297:0:26851:0:(file.c:6821:ll_layout_conf()) [0x200000402:0xf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1782107099.486316:0:26851:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xf:0x0](ffff935d48d1aa08) for lock 0x518b9a3576b3d27 00000080:00010000:0.0:1782107099.486325:0:26851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xf:0x0](ffff935d48d1aa08) 00000080:00010000:0.0:1782107099.486329:0:26851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d27 from it ffffb79701dbbb20 00010000:00010000:0.0:1782107099.486333:0:26851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107099.486342:0:26851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1782107099.486373:0:26851:0:(file.c:6289:ll_getattr_dentry()) START file f6d.sanity-ec:[0x200000402:0xf:0x0](ffff935d48d1aa08), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1782107099.486385:0:26851:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xf:0x0](ffff935d48d1aa08),name=f6d.sanity-ec 00000002:00010000:0.0:1782107099.486403:0:26851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107099.486411:0:26851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107099.486423:0:26851:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782107099.486429:0:26851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782107099.486434:0:26851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xf:0x0](ffff935d48d1aa08) 00000080:00010000:0.0:1782107099.486436:0:26851:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xf:0x0](ffff935d48d1aa08) for lock 0x518b9a3576b3d27 00000080:00010000:0.0:1782107099.486440:0:26851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d27 from it ffffb79701dbbcb8 00010000:00010000:0.0:1782107099.486442:0:26851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107099.486448:0:26851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107099.486492:0:26851:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:0.0:1782107099.486499:0:26851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107099.486506:0:26851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107099.486513:0:26851:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782107099.486520:0:26851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782107099.486524:0:26851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:0.0:1782107099.486531:0:26851:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3d20 00000080:00010000:0.0:1782107099.486535:0:26851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d20 from it ffffb79701dbbc10 00010000:00010000:0.0:1782107099.486539:0:26851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107099.486546:0:26851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107099.486554:0:26851:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:0.0:1782107099.486563:0:26851:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6d.sanity-ec, flags=0 00000080:00200000:0.0:1782107099.486567:0:26851:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:0.0:1782107099.486574:0:26851:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1782107099.486580:0:26851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107099.486588:0:26851:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107099.486593:0:26851:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1782107099.486597:0:26851:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:0.0:1782107099.486599:0:26851:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3d20 00000080:00010000:0.0:1782107099.486602:0:26851:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d20 from it ffffb79701dbbd68 00010000:00010000:0.0:1782107099.486604:0:26851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107099.486611:0:26851:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1782107099.486618:0:26851:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 3 00000080:00200000:0.0:1782107099.486628:0:26851:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08) 00010000:00010000:0.0:1782107099.486784:0:26851:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782107099.486869:0:26851:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1782107099.486891:0:26851:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xf:0x0]: losing layout lock 00010000:00010000:0.0:1782107099.486926:0:26851:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107099.486935:0:26851:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1782107099.486941:0:26851:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1782107099.486944:0:26851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588a000/0x518b9a3576b3d27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7e3d6a8eb3a12a38 expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782107099.486959:0:26851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b400/0x518b9a3576b3d20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a12a1c expref: -99 pid: 26851 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1782107099.486976:0:26851:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1782107099.486984:0:26851:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d44383800 x1868674246958720/t0(0) o36->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782107099.487006:0:26851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d44383800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:26851:1868674246958720:192.168.203.143@tcp:36:rm.0 00000100:00100000:0.0:1782107099.487184:0:26851:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51516d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782107099.489560:0:26851:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d44383800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:26851:1868674246958720:192.168.203.143@tcp:36:rm.0 00000080:00200000:3.0:1782107099.489629:0:26851:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0xf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1782107099.489636:0:26851:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782107099.489667:0:26851:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0xf:0x0](ffff935d48d1aa08) 00010000:00010000:3.0:1782107100.220934:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107100.602501:0:26999:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6e: Write fails when only parity mirror is non-stale ========================================================== 01:44:59 (1782107099) 00000080:00200000:3.0:1782107100.881659:0:27017:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107100.881914:0:27017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107100.881977:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.881988:0:27017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.881997:0:27017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107100.882024:0:27017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246958848:192.168.203.143@tcp:101:lfs.0 00000100:00100000:3.0:1782107100.882129:0:27017:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d4783b600 going to sleep for 11 seconds 00000100:00100000:3.0:1782107100.885918:0:27017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246958848:192.168.203.143@tcp:101:lfs.0 00010000:00010000:3.0:1782107100.885941:0:27017:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.885953:0:27017:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.885966:0:27017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.885995:0:27017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.886008:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.886016:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.886023:0:27017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107100.886046:0:27017:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d443dca80 x1868674246958848/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107116 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782107100.886060:0:27017:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.886073:0:27017:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1782107100.886081:0:27017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1782107100.886107:0:27017:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1782107100.886114:0:27017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3d2e 00000080:00010000:3.0:1782107100.886119:0:27017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107100.886122:0:27017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d2e from it ffffb79701873b58 00010000:00010000:3.0:1782107100.886125:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.886144:0:27017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107100.886182:0:27017:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1782107100.886200:0:27017:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), flags=8 00000080:00200000:3.0:1782107100.886205:0:27017:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=getattr 00000002:00010000:3.0:1782107100.886224:0:27017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107100.886261:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.886268:0:27017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.886275:0:27017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107100.886294:0:27017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246958976:192.168.203.143@tcp:101:lfs.0 00000100:00100000:3.0:1782107100.886361:0:27017:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d4783b600 going to sleep for 11 seconds 00000100:00100000:3.0:1782107100.889654:0:27017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246958976:192.168.203.143@tcp:101:lfs.0 00010000:00010000:3.0:1782107100.889675:0:27017:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889688:0:27017:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889695:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889719:0:27017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889728:0:27017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889734:0:27017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d581cce00 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:3.0:1782107100.889738:0:27017:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889745:0:27017:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889751:0:27017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889769:0:27017:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782107100.889775:0:27017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.889781:0:27017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cce00/0x518b9a3576b3d35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107100.889798:0:27017:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff935d443dca80 x1868674246958976/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107116 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1782107100.889860:0:27017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1782107100.889883:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107100.889895:0:27017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1782107100.889910:0:27017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d2e from it ffffb79701873930 00010000:00010000:3.0:1782107100.889913:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107100.889921:0:27017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107100.889995:0:27017:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107100.890008:0:27017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107100.890015:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107100.890023:0:27017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107100.890312:0:27017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107100.890318:0:27017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107100.890321:0:27017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3d2e 00000080:00010000:3.0:1782107100.890326:0:27017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d2e from it ffffb79701873bf8 00010000:00010000:3.0:1782107100.890329:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107100.890337:0:27017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107100.890346:0:27017:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1782107100.890355:0:27017:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6e.sanity-ec, flags=777 00000080:00200000:3.0:1782107100.890365:0:27017:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107100.890371:0:27017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107100.890379:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107100.890387:0:27017:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107100.890394:0:27017:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107100.890398:0:27017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107100.890400:0:27017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3d2e 00000080:00010000:3.0:1782107100.890404:0:27017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d2e from it ffffb79701873b38 00010000:00010000:3.0:1782107100.890406:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107100.890412:0:27017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1782107100.890420:0:27017:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 3 00000080:00200000:3.0:1782107100.890425:0:27017:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), file ffff935d43848780, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1782107100.890433:0:27017:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=open|creat 00000002:00010000:3.0:1782107100.890449:0:27017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6e.sanity-ec,[0x200000402:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1782107100.890459:0:27017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107100.890494:0:27017:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107100.890508:0:27017:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107100.890511:0:27017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a12a62 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107100.890539:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.890545:0:27017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1782107100.890554:0:27017:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1782107100.890560:0:27017:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d443dca80 x1868674246959232/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1782107100.890569:0:27017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107100.890586:0:27017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246959232:192.168.203.143@tcp:101:lfs.0 00000100:00100000:3.0:1782107100.890848:0:27017:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d4783b600 going to sleep for 11 seconds 00000100:00100000:3.0:1782107100.908735:0:27017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246959232:192.168.203.143@tcp:101:lfs.0 00010000:00010000:3.0:1782107100.908772:0:27017:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908801:0:27017:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 4/0,1 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908851:0:27017:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 4/0,1 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908875:0:27017:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908885:0:27017:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 4/0,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908899:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908906:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 5/1,1 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908913:0:27017:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107100.908924:0:27017:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff935d443dca80 x1868674246959232/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107116 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:3.0:1782107100.908936:0:27017:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff935d443dca80 x1868674246959232/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107116 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782107100.908947:0:27017:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.908957:0:27017:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589935618/16 (0 0) 00000080:00200000:3.0:1782107100.908963:0:27017:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1782107100.908975:0:27017:0:(namei.c:1619:ll_create_it()) VFS Op:name=f6e.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=open|creat 00000080:00200000:3.0:1782107100.909005:0:27017:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0x10:0x0](ffff935d48d7cb08) 00000080:00200000:3.0:1782107100.909016:0:27017:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0x10:0x0], updating i_size 0 00000080:00200000:3.0:1782107100.909099:0:27017:0:(file.c:6821:ll_layout_conf()) [0x200000402:0x10:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1782107100.909110:0:27017:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0x10:0x0](ffff935d48d7cb08) 00000080:00010000:3.0:1782107100.909114:0:27017:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0x10:0x0](ffff935d48d7cb08) for lock 0x518b9a3576b3d3c 00000080:00010000:3.0:1782107100.909124:0:27017:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x10:0x0](ffff935d48d7cb08) 00000080:00200008:3.0:1782107100.909137:0:27017:0:(file.c:1058:ll_file_open()) START file f6e.sanity-ec:[0x200000402:0x10:0x0](ffff935d48d7cb08), flags 120501 00000002:00100000:3.0:1782107100.909157:0:27017:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff935d443dca80 x1868674246959232/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107116 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:3.0:1782107100.909189:0:27017:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3d3c from it ffff935d4384b960 00010000:00010000:3.0:1782107100.909194:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.909203:0:27017:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107100.909223:0:27017:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000402:0x10:0x0](ffff935d48d7cb08), inode mode 81a4 mask 40 00000080:00200000:3.0:1782107100.909270:0:27017:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000402:0x10:0x0](ffff935d48d7cb08), inode mode 81a4 mask 2 00000080:00200000:3.0:1782107100.909281:0:27017:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0x10:0x0](ffff935d48d7cb08), xattr lov 00000002:00010000:3.0:1782107100.909297:0:27017:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0x10:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:3.0:1782107100.909342:0:27017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.909349:0:27017:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1782107100.909359:0:27017:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1782107100.909365:0:27017:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d443df800 x1868674246959488/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1782107100.909385:0:27017:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107100.909405:0:27017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246959488:192.168.203.143@tcp:101:lfs.0 00000100:00100000:3.0:1782107100.909618:0:27017:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d4783b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782107100.919697:0:2403:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.143@tcp (source: 12345-192.168.203.143@tcp) 00000100:00100000:1.0F:1782107100.919948:0:6171:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269114240 00000100:00100000:1.0:1782107100.919971:0:6171:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269114240 00000100:00100000:1.0:1782107100.920028:0:6171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.143@tcp, seq: 17 00000100:00100000:1.0:1782107100.920048:0:6171:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff935d44381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:7836:x1868674269114240:12345-192.168.203.143@tcp:104: 00010000:00010000:1.0:1782107100.920065:0:6171:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782107100.922117:0:6171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782107100.922133:0:6171:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff935d44381500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:7836:x1868674269114240:12345-192.168.203.143@tcp:104: Request processed in 2091us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782107100.922142:0:6171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.143@tcp, seq: 17 00010000:00010000:2.0:1782107100.924873:0:6182:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782107100.924884:0:6182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107100.924894:0:6182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d581cc800 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:2.0:1782107100.924898:0:6182:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107100.924904:0:6182:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107100.924910:0:6182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1782107100.924956:0:6182:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0x10:0x0]: losing layout lock 00010000:00010000:2.0:1782107100.925007:0:6182:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107100.925011:0:6182:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782107100.925053:0:6182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 1/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107100.925061:0:6182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc800/0x518b9a3576b3d3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a12a93 expref: -99 pid: 27017 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782107100.925079:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107100.925081:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782107100.925083:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782107100.925105:0:2413:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782107100.925129:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246959616:192.168.203.143@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782107100.930080:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51a2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246959616:192.168.203.143@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1782107100.930269:0:27017:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff935d47879800: committing for last_committed 4294967350 gen 1 00000100:00100000:3.0:1782107100.930292:0:27017:0:(client.c:3151:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff935d443dca80 x1868674246959232/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107116 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1782107100.930303:0:27017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246959488:192.168.203.143@tcp:101:lfs.0 00010000:00010000:3.0:1782107100.930320:0:27017:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930334:0:27017:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930341:0:27017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930348:0:27017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930357:0:27017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930363:0:27017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d581cc000 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:3.0:1782107100.930367:0:27017:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930391:0:27017:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930398:0:27017:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930405:0:27017:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782107100.930411:0:27017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107100.930418:0:27017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cc000/0x518b9a3576b3d43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 27017 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107100.930441:0:27017:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff935d443df800 x1868674246959488/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 712/608 e 0 to 0 dl 1782107116 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1782107100.930454:0:27017:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:3.0:1782107100.930460:0:27017:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:3.0:1782107100.931230:0:27017:0:(file.c:448:ll_file_release()) START file f6e.sanity-ec:[0x200000402:0x10:0x0](ffff935d48d7cb08), flags 100001 00000002:00100000:3.0:1782107100.931283:0:27017:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff935d443dca80 x1868674246959232/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107116 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:3.0:1782107100.931294:0:27017:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1782107100.931299:0:27017:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d443df800 x1868674246959872/t0(0) o35->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:3.0:1782107100.931320:0:27017:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246959872:192.168.203.143@tcp:35:lfs.0 00000100:00100000:3.0:1782107100.931449:0:27017:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d4783b600 going to sleep for 11 seconds 00000100:00100000:3.0:1782107100.934095:0:27017:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:27017:1868674246959872:192.168.203.143@tcp:35:lfs.0 00000002:00100000:3.0:1782107100.934126:0:27017:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff935d443dca80 x1868674246959232/t4294967350(4294967350) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107116 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1782107101.245858:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107101.760255:0:27144:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6e: @@@@@@ FAIL: create EC file failed 00010000:00010000:3.0:1782107102.268924:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107102.333042:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:87d3e82f-e99c-4ac6-accd-6b70667f4a2e:2413:1868674246960000:192.168.203.143@tcp:400:kworker.0 00000100:00100000:3.0:1782107102.333146:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246960256:192.168.203.143@tcp:400:kworker.0 00000100:00100000:3.0:1782107102.333180:0:2413:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782107102.333187:0:2413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246960128:192.168.203.143@tcp:400:kworker.0 00000100:00100000:3.0:1782107102.335508:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246960128:192.168.203.143@tcp:400:kworker.0 00000100:00100000:3.0:1782107102.335522:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:87d3e82f-e99c-4ac6-accd-6b70667f4a2e:2413:1868674246960000:192.168.203.143@tcp:400:kworker.0 00010000:00080000:3.0:1782107102.335533:0:2413:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff935d443dce00 x1868674246960256/t0(0) o400->lustre-MDT0001-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 224/224 e 0 to 0 dl 1782107118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782107102.335545:0:2413:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2413:1868674246960256:192.168.203.143@tcp:400:kworker.0 Debug log: 301 lines, 301 kept, 0 dropped, 0 bad.