00010000:00010000:2.0F:1787096247.413635:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0F:1787096247.532226:0:25919:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:3.0:1787096247.532251:0:25919:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1787096247.532303:0:25919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 25919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096247.532320:0:25919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096247.532328:0:25919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 25919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096247.532351:0:25919:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b51208a80 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:25919:1873906077047168:192.168.201.152@tcp:101:rm.0 00000100:00100000:3.0:1787096247.532434:0:25919:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b48c25f00 going to sleep for 11 seconds 00000100:00100000:0.0F:1787096247.533637:0:25919:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b51208a80 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:25919:1873906077047168:192.168.201.152@tcp:101:rm.0 00010000:00010000:0.0:1787096247.533663:0:25919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533675:0:25919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533687:0:25919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533698:0:25919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533709:0:25919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533718:0:25919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533726:0:25919:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096247.533738:0:25919:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b51208a80 x1873906077047168/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096263 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096247.533752:0:25919:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533762:0:25919:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1787096247.533768:0:25919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1787096247.533796:0:25919:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:0.0:1787096247.533804:0:25919:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b41004 00000080:00010000:0.0:1787096247.533809:0:25919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096247.533813:0:25919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41004 from it ffffb38a41c83b58 00010000:00010000:0.0:1787096247.533816:0:25919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533825:0:25919:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096247.533848:0:25919:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096247.533860:0:25919:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), flags=8 00000080:00200000:0.0:1787096247.533865:0:25919:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=getattr 00000002:00010000:0.0:1787096247.533882:0:25919:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6b.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096247.533907:0:25919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 25919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533913:0:25919:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25919 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.533921:0:25919:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 25919 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096247.533936:0:25919:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4800a680 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:25919:1873906077047296:192.168.201.152@tcp:101:rm.0 00000100:00100000:0.0:1787096247.533988:0:25919:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b460a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096247.535032:0:25919:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4800a680 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:25919:1873906077047296:192.168.201.152@tcp:101:rm.0 00010000:00010000:0.0:1787096247.535043:0:25919:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535070:0:25919:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535077:0:25919:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535086:0:25919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535095:0:25919:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535105:0:25919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535113:0:25919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 5/2,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535120:0:25919:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1787096247.535131:0:25919:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b4800a680 x1873906077047296/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096263 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1787096247.535141:0:25919:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535149:0:25919:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589935618/14 (0 0) 00000080:00200000:0.0:1787096247.535160:0:25919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1787096247.535171:0:25919:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xe:0x0], updating i_size 0 00000080:00200000:0.0:1787096247.535174:0:25919:0:(namei.c:147:ll_iget()) got inode: [0x200000402:0xe:0x0](ffff972b489200c8): rc = 0 00000080:00200000:0.0:1787096247.535230:0:25919:0:(file.c:6803:ll_layout_conf()) [0x200000402:0xe:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1787096247.535252:0:25919:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xe:0x0](ffff972b489200c8) for lock 0x4ef7bc65b7b4100b 00000080:00010000:0.0:1787096247.535260:0:25919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xe:0x0](ffff972b489200c8) 00000080:00010000:0.0:1787096247.535263:0:25919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4100b from it ffffb38a41c83b20 00010000:00010000:0.0:1787096247.535266:0:25919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096247.535275:0:25919:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200008:0.0:1787096247.535296:0:25919:0:(file.c:6271:ll_getattr_dentry()) START file f6b.sanity-ec:[0x200000402:0xe:0x0](ffff972b489200c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1787096247.535302:0:25919:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0xe:0x0](ffff972b489200c8),name=f6b.sanity-ec 00000002:00010000:0.0:1787096247.535314:0:25919:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xe:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096247.535321:0:25919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096247.535332:0:25919:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 2/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096247.535339:0:25919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096247.535344:0:25919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xe:0x0](ffff972b489200c8) 00000080:00010000:0.0:1787096247.535346:0:25919:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xe:0x0](ffff972b489200c8) for lock 0x4ef7bc65b7b4100b 00000080:00010000:0.0:1787096247.535350:0:25919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b4100b from it ffffb38a41c83cb8 00010000:00010000:0.0:1787096247.535353:0:25919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096247.535373:0:25919:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096247.535409:0:25919:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096247.535416:0:25919:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096247.535421:0:25919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096247.535428:0:25919:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1787096247.535433:0:25919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096247.535436:0:25919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096247.535438:0:25919:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b41004 00000080:00010000:0.0:1787096247.535441:0:25919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41004 from it ffffb38a41c83c10 00010000:00010000:0.0:1787096247.535443:0:25919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1787096247.535448:0:25919:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096247.535455:0:25919:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:0.0:1787096247.535461:0:25919:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6b.sanity-ec, flags=0 00000080:00200000:0.0:1787096247.535464:0:25919:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:0.0:1787096247.535469:0:25919:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1787096247.535472:0:25919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096247.535484:0:25919:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096247.535489:0:25919:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1787096247.535493:0:25919:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:0.0:1787096247.535496:0:25919:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b41004 00000080:00010000:0.0:1787096247.535500:0:25919:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41004 from it ffffb38a41c83d68 00010000:00010000:0.0:1787096247.535503:0:25919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096247.535598:0:25919:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1787096247.535610:0:25919:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 3 00000080:00200000:0.0:1787096247.535664:0:25919:0:(namei.c:2404:ll_unlink()) VFS Op:name=f6b.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348) 00010000:00010000:0.0:1787096247.535709:0:25919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096247.535734:0:25919:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1787096247.535754:0:25919:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xe:0x0]: losing layout lock 00010000:00010000:0.0:1787096247.535800:0:25919:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096247.535807:0:25919:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1787096247.535820:0:25919:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1787096247.535823:0:25919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b41523000/0x4ef7bc65b7b4100b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x9eebb2eb7f50d45b expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1787096247.535843:0:25919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b61e9b200/0x4ef7bc65b7b41004 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d43f expref: -99 pid: 25919 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000020:00100000:0.0:1787096247.535872:0:25919:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1787096247.535878:0:25919:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b4800a680 x1873906077047552/t0(0) o36->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096247.535891:0:25919:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b4800a680 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:25919:1873906077047552:192.168.201.152@tcp:36:rm.0 00000100:00100000:0.0:1787096247.535935:0:25919:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b460a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096247.537341:0:25919:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b4800a680 pname:cluuid:pid:xid:nid:opc:job rm:f9858421-28a9-4744-99eb-72e5bedc52c4:25919:1873906077047552:192.168.201.152@tcp:36:rm.0 00000080:00200000:0.0:1787096247.537394:0:25919:0:(vvp_io.c:1944:vvp_io_init()) [0x200000402:0xe:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1787096247.537401:0:25919:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0xe:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1787096247.537415:0:25919:0:(llite_lib.c:1942:ll_clear_inode()) VFS Op:inode=[0x200000402:0xe:0x0](ffff972b489200c8) 00000001:02000400:3.0:1787096248.076919:0:26071:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6c: EC with multiple data mirrors - parity never selected ========================================================== 19:37:27 (1787096247) 00010000:00010000:2.0:1787096248.438621:0:6161:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0F:1787096248.567909:0:26209:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-ec test_6c needs >= 8 OSTs 00000001:02000400:2.0:1787096249.133117:0:26363:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 6d: Manually mark parity mirror stale and resync ========================================================== 19:37:28 (1787096248) 00000080:00200000:2.0:1787096249.191012:0:26377:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:2.0:1787096249.191038:0:26377:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096249.191095:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.191106:0:26377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.191117:0:26377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096249.191142:0:26377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48cb3480 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077047680:192.168.201.152@tcp:101:lfs.0 00000100:00100000:2.0:1787096249.191246:0:26377:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b44fbf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096249.192836:0:26377:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48cb3480 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077047680:192.168.201.152@tcp:101:lfs.0 00010000:00010000:2.0:1787096249.192852:0:26377:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.192863:0:26377:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.192875:0:26377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.192886:0:26377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.192897:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.192911:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.192918:0:26377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096249.192929:0:26377:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff972b48cb3480 x1873906077047680/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 576/688 e 0 to 0 dl 1787096265 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096249.192942:0:26377:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.192952:0:26377:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1787096249.192958:0:26377:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1787096249.192977:0:26377:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:00010000:2.0:1787096249.192984:0:26377:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b41012 00000080:00010000:2.0:1787096249.192989:0:26377:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:2.0:1787096249.192993:0:26377:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41012 from it ffffb38a41c53b58 00010000:00010000:2.0:1787096249.192996:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.193006:0:26377:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096249.193028:0:26377:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:2.0:1787096249.193041:0:26377:0:(namei.c:1331:ll_lookup_nd()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), flags=8 00000080:00200000:2.0:1787096249.193046:0:26377:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=getattr 00000002:00010000:2.0:1787096249.193066:0:26377:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6d.sanity-ec,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096249.193091:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.193098:0:26377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.193106:0:26377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096249.193119:0:26377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48cb3480 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077047808:192.168.201.152@tcp:101:lfs.0 00000100:00100000:2.0:1787096249.193184:0:26377:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b44fbf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096249.194084:0:26377:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48cb3480 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077047808:192.168.201.152@tcp:101:lfs.0 00010000:00010000:2.0:1787096249.194094:0:26377:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194104:0:26377:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194111:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194117:0:26377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194124:0:26377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194130:0:26377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b50d95800 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:2.0:1787096249.194134:0:26377:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194148:0:26377:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194155:0:26377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194178:0:26377:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787096249.194185:0:26377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194192:0:26377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d95800/0x4ef7bc65b7b41019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096249.194207:0:26377:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff972b48cb3480 x1873906077047808/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 584/584 e 0 to 0 dl 1787096265 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787096249.194216:0:26377:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:2.0:1787096249.194231:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096249.194242:0:26377:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:2.0:1787096249.194250:0:26377:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41012 from it ffffb38a41c53930 00010000:00010000:2.0:1787096249.194253:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096249.194261:0:26377:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096249.194316:0:26377:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:2.0:1787096249.194326:0:26377:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096249.194334:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096249.194343:0:26377:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:2.0:1787096249.194350:0:26377:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096249.194355:0:26377:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:2.0:1787096249.194358:0:26377:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b41012 00000080:00010000:2.0:1787096249.194363:0:26377:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41012 from it ffffb38a41c53bf8 00010000:00010000:2.0:1787096249.194366:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:2.0:1787096249.194374:0:26377:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787096249.194384:0:26377:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 1 00000080:00200000:2.0:1787096249.194391:0:26377:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=f6d.sanity-ec, flags=777 00000080:00200000:2.0:1787096249.194396:0:26377:0:(file.c:6166:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348),name=/ 00000002:00010000:2.0:1787096249.194403:0:26377:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1787096249.194409:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096249.194417:0:26377:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:2.0:1787096249.194436:0:26377:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:2.0:1787096249.194441:0:26377:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) 00000080:00010000:2.0:1787096249.194444:0:26377:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff972b48925348) for lock 0x4ef7bc65b7b41012 00000080:00010000:2.0:1787096249.194448:0:26377:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41012 from it ffffb38a41c53b38 00010000:00010000:2.0:1787096249.194451:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:2.0:1787096249.194459:0:26377:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:2.0:1787096249.194468:0:26377:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff972b48925348), inode mode 41ed mask 3 00000080:00200000:2.0:1787096249.194473:0:26377:0:(namei.c:1408:ll_atomic_open()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), file ffff972b44d27080, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1787096249.194481:0:26377:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=open|creat 00000002:00010000:2.0:1787096249.194494:0:26377:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f6d.sanity-ec,[0x200000402:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1787096249.194504:0:26377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787096249.194588:0:26377:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787096249.194596:0:26377:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096249.194599:0:26377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94c00/0x4ef7bc65b7b41012 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x9eebb2eb7f50d485 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:2.0:1787096249.194627:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.194644:0:26377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787096249.194656:0:26377:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787096249.194663:0:26377:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b48cb3480 x1873906077048064/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/66320 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787096249.194672:0:26377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096249.194686:0:26377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48cb3480 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077048064:192.168.201.152@tcp:101:lfs.0 00000100:00100000:2.0:1787096249.194793:0:26377:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b44fbf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096249.196209:0:26377:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48cb3480 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077048064:192.168.201.152@tcp:101:lfs.0 00010000:00010000:2.0:1787096249.196222:0:26377:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196241:0:26377:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196250:0:26377:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 4/0,1 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196258:0:26377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196267:0:26377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 4/0,1 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196288:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196295:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 5/1,1 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196303:0:26377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096249.196312:0:26377:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff972b48cb3480 x1873906077048064/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096265 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00100000:2.0:1787096249.196324:0:26377:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff972b48cb3480 x1873906077048064/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096265 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1787096249.196335:0:26377:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196344:0:26377:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff972b454d0000 type 13 mode 4 res 8589935618/15 (0 0) 00000080:00200000:2.0:1787096249.196348:0:26377:0:(namei.c:952:ll_intent_lock()) intent lock 3 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00000080:00200000:2.0:1787096249.196355:0:26377:0:(namei.c:1619:ll_create_it()) VFS Op:name=f6d.sanity-ec, dir=[0x200000007:0x1:0x0](ffff972b48925348), intent=open|creat 00000080:00200000:2.0:1787096249.196391:0:26377:0:(llite_lib.c:3211:ll_read_inode2()) VFS Op:inode=[0x200000402:0xf:0x0](ffff972b489d3248) 00000080:00200000:2.0:1787096249.196396:0:26377:0:(llite_lib.c:2974:ll_update_inode()) inode=[0x200000402:0xf:0x0], updating i_size 0 00000080:00200000:2.0:1787096249.196489:0:26377:0:(file.c:6803:ll_layout_conf()) [0x200000402:0xf:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1787096249.196500:0:26377:0:(namei.c:1585:ll_create_node()) setting l_ast_data to inode [0x200000402:0xf:0x0](ffff972b489d3248) 00000080:00010000:2.0:1787096249.196504:0:26377:0:(llite_internal.h:2011:ll_set_lock_data()) setting l_data to inode [0x200000402:0xf:0x0](ffff972b489d3248) for lock 0x4ef7bc65b7b41020 00000080:00010000:2.0:1787096249.196541:0:26377:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0xf:0x0](ffff972b489d3248) 00000080:00200008:2.0:1787096249.196557:0:26377:0:(file.c:1058:ll_file_open()) START file f6d.sanity-ec:[0x200000402:0xf:0x0](ffff972b489d3248), flags 120501 00000002:00100000:2.0:1787096249.196576:0:26377:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff972b48cb3480 x1873906077048064/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096265 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00010000:2.0:1787096249.196608:0:26377:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x4ef7bc65b7b41020 from it ffff972b47163600 00010000:00010000:2.0:1787096249.196613:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196622:0:26377:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1787096249.196636:0:26377:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0xf:0x0](ffff972b489d3248), inode mode 81a4 mask 40 00000080:00200000:2.0:1787096249.196663:0:26377:0:(file.c:6638:ll_inode_permission()) VFS Op:inode=[0x200000402:0xf:0x0](ffff972b489d3248), inode mode 81a4 mask 2 00000080:00200000:2.0:1787096249.196671:0:26377:0:(xattr.c:411:ll_xattr_set()) VFS Op:inode=[0x200000402:0xf:0x0](ffff972b489d3248), xattr lov 00000002:00010000:2.0:1787096249.196684:0:26377:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000402:0xf:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 040000002 00010000:00010000:2.0:1787096249.196710:0:26377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.196718:0:26377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787096249.196727:0:26377:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1787096249.196734:0:26377:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b48cb2680 x1873906077048320/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 712/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:2.0:1787096249.196742:0:26377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096249.196755:0:26377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48cb2680 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077048320:192.168.201.152@tcp:101:lfs.0 00000100:00100000:2.0:1787096249.196889:0:26377:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b44fbf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096249.197708:0:2400:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.152@tcp (source: 12345-192.168.201.152@tcp) 00000100:00100000:2.0:1787096249.197760:0:6153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906084439808 00000100:00100000:2.0:1787096249.197768:0:6153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906084439808 00000100:00100000:2.0:1787096249.197823:0:6153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.152@tcp, seq: 16 00000100:00100000:2.0:1787096249.197834:0:6153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff972b51209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:6477:x1873906084439808:12345-192.168.201.152@tcp:104: 00010000:00010000:2.0:1787096249.197847:0:6153:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1787096249.197915:0:6153:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096249.197924:0:6153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff972b51209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:f9858421-28a9-4744-99eb-72e5bedc52c4+5:6477:x1873906084439808:12345-192.168.201.152@tcp:104: Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096249.197936:0:6153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.152@tcp, seq: 16 00010000:00010000:1.0:1787096249.197945:0:6160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787096249.197954:0:6160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096249.197966:0:6160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b50d94600 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:1.0:1787096249.197971:0:6160:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096249.197982:0:6160:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096249.197991:0:6160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:1.0:1787096249.198029:0:6160:0:(vvp_object.c:117:vvp_conf_set()) [0x200000402:0xf:0x0]: losing layout lock 00010000:00010000:1.0:1787096249.198072:0:6160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096249.198080:0:6160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787096249.198103:0:6160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096249.198111:0:6160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94600/0x4ef7bc65b7b41020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x1b/0x1b rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x9eebb2eb7f50d4b6 expref: -99 pid: 26377 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1787096249.198127:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096249.198131:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096249.198134:0:6160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096249.198148:0:2406:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b45489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9858421-28a9-4744-99eb-72e5bedc52c4:2406:1873906077048448:192.168.201.152@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1787096249.199109:0:2406:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b45489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f9858421-28a9-4744-99eb-72e5bedc52c4:2406:1873906077048448:192.168.201.152@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787096249.199396:0:26377:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48cb2680 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077048320:192.168.201.152@tcp:101:lfs.0 00010000:00010000:2.0:1787096249.199407:0:26377:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199417:0:26377:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199424:0:26377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199431:0:26377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199437:0:26377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199443:0:26377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff972b50d94000 already unused, calling callback (ffffffffc1c3eb70) 00010000:00010000:2.0:1787096249.199446:0:26377:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199459:0:26377:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x206400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199466:0:26377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x20e400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199472:0:26377:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1787096249.199478:0:26377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096249.199484:0:26377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff972b497ed000 lock: ffff972b50d94000/0x4ef7bc65b7b41027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 26377 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1787096249.199503:0:26377:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff972b48cb2680 x1873906077048320/t0(0) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 712/608 e 0 to 0 dl 1787096265 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:2.0:1787096249.199551:0:26377:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc -28 00000080:00200000:2.0:1787096249.199559:0:26377:0:(file.c:840:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200008:2.0:1787096249.199701:0:26377:0:(file.c:448:ll_file_release()) START file f6d.sanity-ec:[0x200000402:0xf:0x0](ffff972b489d3248), flags 100001 00000002:00100000:2.0:1787096249.199735:0:26377:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff972b48cb3480 x1873906077048064/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096265 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000020:00100000:2.0:1787096249.199745:0:26377:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff972b497ed000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1787096249.199750:0:26377:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff972b48cb2680 x1873906077048704/t0(0) o35->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:2.0:1787096249.199765:0:26377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff972b48cb2680 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077048704:192.168.201.152@tcp:35:lfs.0 00000100:00100000:2.0:1787096249.199818:0:26377:0:(client.c:2692:ptlrpc_set_wait()) set ffff972b44fbf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096249.200608:0:26377:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff972b48cb2680 pname:cluuid:pid:xid:nid:opc:job lfs:f9858421-28a9-4744-99eb-72e5bedc52c4:26377:1873906077048704:192.168.201.152@tcp:35:lfs.0 00000002:00100000:2.0:1787096249.200627:0:26377:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff972b48cb3480 x1873906077048064/t4294967347(4294967347) o101->lustre-MDT0000-mdc-ffff972b497ed000@192.168.201.152@tcp:12/10 lens 528/608 e 0 to 0 dl 1787096265 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1787096249.461644:0:6161:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096249.700819:0:26508:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_6d: @@@@@@ FAIL: create EC file failed Debug log: 290 lines, 290 kept, 0 dropped, 0 bad.