00010000:00010000:3.0F:1782107068.479638:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107069.502456:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1782107070.098115:0:24176:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107070.098140:0:24176:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107070.098195:0:24176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.098206:0:24176:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.098215:0:24176:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107070.098239:0:24176:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24176:1868674246949376:192.168.203.143@tcp:101:rm.0 00000100:00100000:3.0:1782107070.098338:0:24176:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51a03300 going to sleep for 11 seconds 00000100:00100000:3.0:1782107070.100768:0:24176:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24176:1868674246949376:192.168.203.143@tcp:101:rm.0 00010000:00010000:3.0:1782107070.100790:0:24176:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.100827:0:24176:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.100839:0:24176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.100849:0:24176:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.100860:0:24176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.100881:0:24176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.100887:0:24176:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107070.100898:0:24176:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d443df800 x1868674246949376/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107086 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782107070.100910:0:24176:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.100922:0:24176:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1782107070.100928:0:24176:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:3.0:1782107070.100952:0:24176:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:3.0:1782107070.100958:0:24176:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3c78 00000080:00010000:3.0:1782107070.100963:0:24176:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107070.100966:0:24176:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c78 from it ffffb79701d03b58 00010000:00010000:3.0:1782107070.100969:0:24176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.101293:0:24176:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107070.101320:0:24176:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1782107070.101337:0:24176:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), flags=8 00000080:00200000:3.0:1782107070.101341:0:24176:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=getattr 00000002:00010000:3.0:1782107070.101365:0:24176:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5a.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107070.101399:0:24176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.101407:0:24176:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.101415:0:24176:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24176 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107070.101432:0:24176:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24176:1868674246949504:192.168.203.143@tcp:101:rm.0 00000100:00100000:3.0:1782107070.101495:0:24176:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51a03300 going to sleep for 11 seconds 00000100:00100000:3.0:1782107070.104298:0:24176:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24176:1868674246949504:192.168.203.143@tcp:101:rm.0 00010000:00010000:3.0:1782107070.104321:0:24176:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104351:0:24176:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104361:0:24176:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104371:0:24176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104381:0:24176:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104393:0:24176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104409:0:24176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104418:0:24176:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107070.104429:0:24176:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d443df800 x1868674246949504/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107086 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:3.0:1782107070.104442:0:24176:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104452:0:24176:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589935618/11 (0 0) 00000080:00200000:3.0:1782107070.104458:0:24176:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:3.0:1782107070.104474:0:24176:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xb:0x0], updating i_size 0 00000080:00200000:3.0:1782107070.104477:0:24176:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0xb:0x0](ffff935d48d19148): rc = 0 00000080:00200000:3.0:1782107070.104515:0:24176:0:(file.c:6821:ll_layout_conf()) [0x200000402:0xb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1782107070.104533:0:24176:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xb:0x0](ffff935d48d19148) for lock 0x518b9a3576b3c7f 00000080:00010000:3.0:1782107070.104542:0:24176:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xb:0x0](ffff935d48d19148) 00000080:00010000:3.0:1782107070.104545:0:24176:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c7f from it ffffb79701d03b20 00010000:00010000:3.0:1782107070.104549:0:24176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107070.104557:0:24176:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:3.0:1782107070.104592:0:24176:0:(file.c:6289:ll_getattr_dentry()) START file f5a.sanity-ec:[0x200000402:0xb:0x0](ffff935d48d19148), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1782107070.104603:0:24176:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xb:0x0](ffff935d48d19148),name=f5a.sanity-ec 00000002:00010000:3.0:1782107070.104621:0:24176:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xb:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107070.104629:0:24176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107070.104639:0:24176:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107070.104646:0:24176:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107070.104651:0:24176:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xb:0x0](ffff935d48d19148) 00000080:00010000:3.0:1782107070.104653:0:24176:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xb:0x0](ffff935d48d19148) for lock 0x518b9a3576b3c7f 00000080:00010000:3.0:1782107070.104656:0:24176:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c7f from it ffffb79701d03cb8 00010000:00010000:3.0:1782107070.104659:0:24176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107070.104665:0:24176:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107070.104726:0:24176:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107070.104734:0:24176:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107070.104740:0:24176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107070.104748:0:24176:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107070.104754:0:24176:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107070.104758:0:24176:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107070.104765:0:24176:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3c78 00000080:00010000:3.0:1782107070.104769:0:24176:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c78 from it ffffb79701d03c10 00010000:00010000:3.0:1782107070.104772:0:24176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107070.104779:0:24176:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107070.104788:0:24176:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1782107070.104796:0:24176:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5a.sanity-ec, flags=0 00000080:00200000:3.0:1782107070.104800:0:24176:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107070.104826:0:24176:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107070.104834:0:24176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107070.104842:0:24176:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107070.104849:0:24176:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107070.104853:0:24176:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107070.104855:0:24176:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3c78 00000080:00010000:3.0:1782107070.104859:0:24176:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c78 from it ffffb79701d03d68 00010000:00010000:3.0:1782107070.104862:0:24176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107070.104870:0:24176:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107070.104879:0:24176:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 3 00000080:00200000:3.0:1782107070.104889:0:24176:0:(namei.c:2404:ll_unlink()) VFS Op:name=f5a.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08) 00010000:00010000:3.0:1782107070.104924:0:24176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107070.104945:0:24176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107070.104962:0:24176:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xb:0x0]: losing layout lock 00010000:00010000:3.0:1782107070.105008:0:24176:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 1/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107070.105017:0:24176:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107070.105023:0:24176:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:3.0:1782107070.105026:0:24176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x7e3d6a8eb3a127d0 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107070.105040:0:24176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd400/0x518b9a3576b3c78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a127b4 expref: -99 pid: 24176 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:3.0:1782107070.105055:0:24176:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1782107070.105063:0:24176:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d443df800 x1868674246949760/t0(0) o36->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782107070.105084:0:24176:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24176:1868674246949760:192.168.203.143@tcp:36:rm.0 00000100:00100000:3.0:1782107070.105158:0:24176:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51a03300 going to sleep for 11 seconds 00000100:00100000:3.0:1782107070.119686:0:24176:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df800 pname:cluuid:pid:xid:nid:opc:job rm:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24176:1868674246949760:192.168.203.143@tcp:36:rm.0 00000080:00200000:3.0:1782107070.119765:0:24176:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0xb:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:3.0:1782107070.119785:0:24176:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xb:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1782107070.119832:0:24176:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0xb:0x0](ffff935d48d19148) 00010000:00010000:3.0:1782107070.525220:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107071.551453:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1782107071.619143:0:2414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:87d3e82f-e99c-4ac6-accd-6b70667f4a2e:2414:1868674246949888:192.168.203.143@tcp:400:kworker.0 00000100:00100000:2.0:1782107071.619260:0:2414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2414:1868674246950144:192.168.203.143@tcp:400:kworker.0 00000100:00100000:2.0:1782107071.619295:0:2414:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782107071.619302:0:2414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2414:1868674246950016:192.168.203.143@tcp:400:kworker.0 00010000:00080000:2.0:1782107071.644342:0:2414:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff935d51a2ea00 x1868674246950144/t0(0) o400->lustre-MDT0001-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 224/224 e 0 to 0 dl 1782107087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782107071.644363:0:2414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51a2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2414:1868674246950144:192.168.203.143@tcp:400:kworker.0 00000100:00100000:3.0:1782107071.653357:0:2414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51a2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2414:1868674246950016:192.168.203.143@tcp:400:kworker.0 00000100:00100000:3.0:1782107071.653375:0:2414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51a2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:87d3e82f-e99c-4ac6-accd-6b70667f4a2e:2414:1868674246949888:192.168.203.143@tcp:400:kworker.0 00000001:02000400:3.0:1782107072.198201:0:24322:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 5b: EC FLR state transitions with writes to different components ========================================================== 01:44:30 (1782107070) 00000080:00200000:1.0F:1782107072.376130:0:24335:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:1.0:1782107072.376158:0:24335:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1782107072.376209:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.376219:0:24335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.376229:0:24335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107072.376262:0:24335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51377800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950272:192.168.203.143@tcp:101:lfs.0 00000100:00100000:1.0:1782107072.380459:0:24335:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d43e89840 going to sleep for 11 seconds 00000100:00100000:1.0:1782107072.386648:0:24335:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51377800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950272:192.168.203.143@tcp:101:lfs.0 00010000:00010000:1.0:1782107072.386669:0:24335:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386681:0:24335:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386762:0:24335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386773:0:24335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386785:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386792:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386827:0:24335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:1.0:1782107072.386838:0:24335:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff935d51377800 x1868674246950272/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 576/688 e 0 to 0 dl 1782107088 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:1.0:1782107072.386852:0:24335:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386862:0:24335:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1782107072.386869:0:24335:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:1.0:1782107072.386896:0:24335:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:1.0:1782107072.386902:0:24335:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3c86 00000080:00010000:1.0:1782107072.386907:0:24335:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:1.0:1782107072.386910:0:24335:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c86 from it ffffb79701653b58 00010000:00010000:1.0:1782107072.386913:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.386923:0:24335:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1782107072.386950:0:24335:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:1.0:1782107072.386965:0:24335:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), flags=8 00000080:00200000:1.0:1782107072.386969:0:24335:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=getattr 00000002:00010000:1.0:1782107072.386989:0:24335:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1782107072.387025:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.387041:0:24335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782107072.387050:0:24335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782107072.387070:0:24335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d51377800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950400:192.168.203.143@tcp:101:lfs.0 00000100:00100000:1.0:1782107072.387139:0:24335:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d43e89840 going to sleep for 11 seconds 00000100:00100000:3.0:1782107072.399265:0:24335:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d51377800 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950400:192.168.203.143@tcp:101:lfs.0 00010000:00010000:3.0:1782107072.399287:0:24335:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399301:0:24335:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399307:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399313:0:24335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399320:0:24335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399326:0:24335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d47ca5c00 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:3.0:1782107072.399330:0:24335:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399335:0:24335:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399351:0:24335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399357:0:24335:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1782107072.399363:0:24335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.399369:0:24335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca5c00/0x518b9a3576b3c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1782107072.399383:0:24335:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff935d51377800 x1868674246950400/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 584/584 e 0 to 0 dl 1782107088 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:3.0:1782107072.399396:0:24335:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:3.0:1782107072.399418:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.399429:0:24335:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:3.0:1782107072.399436:0:24335:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c86 from it ffffb79701653930 00010000:00010000:3.0:1782107072.399440:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.399447:0:24335:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107072.399516:0:24335:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107072.399529:0:24335:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107072.399541:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107072.399550:0:24335:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1782107072.399556:0:24335:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107072.399561:0:24335:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107072.399564:0:24335:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3c86 00000080:00010000:3.0:1782107072.399569:0:24335:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c86 from it ffffb79701653bf8 00010000:00010000:3.0:1782107072.399571:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782107072.399578:0:24335:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107072.399587:0:24335:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 1 00000080:00200000:3.0:1782107072.399596:0:24335:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f5b.sanity-ec, flags=777 00000080:00200000:3.0:1782107072.399600:0:24335:0:(file.c:6184:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08),name=/ 00000002:00010000:3.0:1782107072.399606:0:24335:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1782107072.399612:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107072.399620:0:24335:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:3.0:1782107072.399625:0:24335:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1782107072.399629:0:24335:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) 00000080:00010000:3.0:1782107072.399631:0:24335:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff935d48d1cb08) for lock 0x518b9a3576b3c86 00000080:00010000:3.0:1782107072.399642:0:24335:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c86 from it ffffb79701653b38 00010000:00010000:3.0:1782107072.399645:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:3.0:1782107072.399651:0:24335:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1782107072.399659:0:24335:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff935d48d1cb08), inode mode 41ed mask 3 00000080:00200000:3.0:1782107072.399664:0:24335:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), file ffff935d45370f00, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1782107072.399672:0:24335:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=open|creat 00000002:00010000:3.0:1782107072.399705:0:24335:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f5b.sanity-ec,[0x200000402:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1782107072.399716:0:24335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107072.399753:0:24335:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107072.399760:0:24335:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107072.399762:0:24335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d47ca4c00/0x518b9a3576b3c86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x7e3d6a8eb3a127fa expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:3.0:1782107072.399797:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782107072.400074:0:24335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1782107072.400086:0:24335:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1782107072.400093:0:24335:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d443df100 x1868674246950656/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:3.0:1782107072.400109:0:24335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782107072.400130:0:24335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950656:192.168.203.143@tcp:101:lfs.0 00000100:00100000:3.0:1782107072.400393:0:24335:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d51a03e40 going to sleep for 11 seconds 00000100:00100000:0.0F:1782107072.414586:0:24335:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443df100 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950656:192.168.203.143@tcp:101:lfs.0 00010000:00010000:0.0:1782107072.414619:0:24335:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414648:0:24335:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414656:0:24335:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414668:0:24335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414677:0:24335:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414690:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414698:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414706:0:24335:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782107072.414718:0:24335:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff935d443df100 x1868674246950656/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107088 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1782107072.414731:0:24335:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff935d443df100 x1868674246950656/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107088 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1782107072.414750:0:24335:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.414760:0:24335:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff935d60d75400 type 13 mode 4 res 8589935618/12 (0 0) 00000080:00200000:0.0:1782107072.414766:0:24335:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1782107072.414777:0:24335:0:(namei.c:1619:ll_create_it()) VFS Op:name=f5b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff935d48d1cb08), intent=open|creat 00000080:00200000:0.0:1782107072.414981:0:24335:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0xc:0x0](ffff935d48d8d348) 00000080:00200000:0.0:1782107072.414988:0:24335:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xc:0x0], updating i_size 0 00000080:00200000:0.0:1782107072.415064:0:24335:0:(file.c:6821:ll_layout_conf()) [0x200000402:0xc:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1782107072.415075:0:24335:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0xc:0x0](ffff935d48d8d348) 00000080:00010000:0.0:1782107072.415079:0:24335:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xc:0x0](ffff935d48d8d348) for lock 0x518b9a3576b3c94 00000080:00010000:0.0:1782107072.415087:0:24335:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xc:0x0](ffff935d48d8d348) 00000080:00200008:0.0:1782107072.415098:0:24335:0:(file.c:1058:ll_file_open()) START file f5b.sanity-ec:[0x200000402:0xc:0x0](ffff935d48d8d348), flags 120501 00000002:00100000:0.0:1782107072.415115:0:24335:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff935d443df100 x1868674246950656/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107088 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:0.0:1782107072.415143:0:24335:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x518b9a3576b3c94 from it ffff935d4384bea0 00010000:00010000:0.0:1782107072.415146:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.415155:0:24335:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1782107072.415176:0:24335:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000402:0xc:0x0](ffff935d48d8d348), inode mode 81a4 mask 40 00000080:00200000:0.0:1782107072.415220:0:24335:0:(file.c:6656:ll_inode_permission()) VFS Op:inode=[0x200000402:0xc:0x0](ffff935d48d8d348), inode mode 81a4 mask 2 00000080:00200000:0.0:1782107072.415228:0:24335:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0xc:0x0](ffff935d48d8d348), xattr lov 00000002:00010000:0.0:1782107072.415255:0:24335:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xc:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:0.0:1782107072.415306:0:24335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.415313:0:24335:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1782107072.415324:0:24335:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1782107072.415330:0:24335:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d44380a80 x1868674246950912/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 1032/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1782107072.415338:0:24335:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782107072.415357:0:24335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d44380a80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950912:192.168.203.143@tcp:101:lfs.0 00000100:00100000:0.0:1782107072.415499:0:24335:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d517f86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782107072.429566:0:2403:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.143@tcp (source: 12345-192.168.203.143@tcp) 00000100:00100000:0.0:1782107072.431439:0:6172:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782107072.431465:0:6172:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1868674269102976 00000100:00100000:0.0:1782107072.431474:0:6172:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1868674269102976 00000100:00100000:0.0:1782107072.431531:0:6172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.143@tcp, seq: 13 00000100:00100000:0.0:1782107072.431542:0:6172:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff935d485f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:8982:x1868674269102976:12345-192.168.203.143@tcp:104: 00010000:00010000:0.0:1782107072.431559:0:6172:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782107072.431631:0:6172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782107072.431637:0:6172:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff935d485f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eadce33-9ab8-4caf-b349-1b7b3db092bc+5:8982:x1868674269102976:12345-192.168.203.143@tcp:104: Request processed in 98us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1782107072.431645:0:6172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.143@tcp, seq: 13 00010000:00010000:3.0:1782107072.433067:0:6182:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782107072.433079:0:6182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.433092:0:6182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d581cd800 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:3.0:1782107072.433097:0:6182:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.433106:0:6182:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.433116:0:6182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:3.0:1782107072.433167:0:6182:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xc:0x0]: losing layout lock 00010000:00010000:3.0:1782107072.433223:0:6182:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.433230:0:6182:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782107072.433269:0:6182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.433277:0:6182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d581cd800/0x518b9a3576b3c94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xc:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x7e3d6a8eb3a1282b expref: -99 pid: 24335 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782107072.433300:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107072.433302:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782107072.433304:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782107072.433312:0:2414:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782107072.433339:0:2414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d443dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2414:1868674246951040:192.168.203.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782107072.437425:0:24335:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d44380a80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246950912:192.168.203.143@tcp:101:lfs.0 00010000:00010000:0.0:1782107072.437449:0:24335:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437472:0:24335:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437479:0:24335:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437487:0:24335:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437497:0:24335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437504:0:24335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff935d4588b200 already unused, calling callback (ffffffffc1a7ece0) 00010000:00010000:0.0:1782107072.437509:0:24335:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437517:0:24335:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437525:0:24335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437532:0:24335:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1782107072.437540:0:24335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782107072.437547:0:24335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff935d47879800 lock: ffff935d4588b200/0x518b9a3576b3c9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 24335 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1782107072.437578:0:24335:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff935d44380a80 x1868674246950912/t0(0) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 1032/608 e 0 to 0 dl 1782107088 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1782107072.437604:0:24335:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:0.0:1782107072.437613:0:24335:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:0.0:1782107072.437931:0:24335:0:(file.c:448:ll_file_release()) START file f5b.sanity-ec:[0x200000402:0xc:0x0](ffff935d48d8d348), flags 100001 00000002:00100000:0.0:1782107072.437978:0:24335:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff935d443df100 x1868674246950656/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107088 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1782107072.437988:0:24335:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff935d47879800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1782107072.437995:0:24335:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff935d44380a80 x1868674246951296/t0(0) o35->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1782107072.438014:0:24335:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff935d44380a80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246951296:192.168.203.143@tcp:35:lfs.0 00000100:00100000:3.0:1782107072.438052:0:2414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d443dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2eadce33-9ab8-4caf-b349-1b7b3db092bc:2414:1868674246951040:192.168.203.143@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1782107072.438190:0:24335:0:(client.c:2692:ptlrpc_set_wait()) set ffff935d50fcd900 going to sleep for 11 seconds 00000100:00100000:2.0:1782107072.443357:0:24335:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff935d44380a80 pname:cluuid:pid:xid:nid:opc:job lfs:2eadce33-9ab8-4caf-b349-1b7b3db092bc:24335:1868674246951296:192.168.203.143@tcp:35:lfs.0 00000002:00100000:2.0:1782107072.443392:0:24335:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff935d443df100 x1868674246950656/t4294967338(4294967338) o101->lustre-MDT0000-mdc-ffff935d47879800@192.168.203.143@tcp:12/10 lens 528/608 e 0 to 0 dl 1782107088 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1782107072.575590:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782107073.598876:0:6182:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782107073.758494:0:24467:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_5b: @@@@@@ FAIL: setstripe failed 00010000:00010000:1.0:1782107074.627021:0:6181:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 302 lines, 302 kept, 0 dropped, 0 bad.