00010000:00010000:0.0F:1783145948.218296:0:289345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1783145949.242203:0:293257:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1783145950.266178:0:289866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1783145950.675824:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145950.675853:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.675872:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.675887:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.675893:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145950.675899:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145950.675902:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb6793466 00000080:00010000:0.0:1783145950.675910:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb6793466 from it ffffb82641c3bb58 00010000:00010000:0.0:1783145950.675914:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.675919:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.675933:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.675940:0:307651:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=8 00000080:00200008:0.0:1783145950.675947:0:307651:0:(file.c:6217:ll_getattr_dentry()) START file d77r.sanityn:[0x2000013a1:0x25:0x0](ffff920e1d2d0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1783145950.675950:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908),name=d77r.sanityn 00000002:00010000:0.0:1783145950.675959:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2000013a1:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.675964:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 30 res 8589939617/37 (0 0) 00010000:00010000:0.0:1783145950.676001:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.676028:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.676047:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.676075:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162048:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.676171:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.677484:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162048:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.677512:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677521:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677527:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677536:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677543:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677550:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 5/2,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677554:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 5/2,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677568:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.677576:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143ce00 x1869755188162048/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 576/688 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.677591:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677597:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939617/37 (0 0) 00000080:00200000:0.0:1783145950.677601:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1783145950.677621:0:307651:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x2000013a1:0x25:0x0], updating i_size 4096 00000080:00010000:0.0:1783145950.677628:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a1:0x25:0x0](ffff920e1d2d0908) for lock 0x91d81fafb679b8cc 00000080:00010000:0.0:1783145950.677633:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00000080:00010000:0.0:1783145950.677635:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8cc from it ffffb82641c3bcb8 00010000:00010000:0.0:1783145950.677638:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677647:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.677687:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145950.677694:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.677699:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.677704:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.677713:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145950.677716:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145950.677718:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb6793466 00000080:00010000:0.0:1783145950.677720:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb6793466 from it ffffb82641c3bbf8 00010000:00010000:0.0:1783145950.677722:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.677728:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.677733:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.677735:0:307651:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=266 00000080:00200000:0.0:1783145950.677738:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 44 00000080:00200008:0.0:1783145950.677742:0:307651:0:(file.c:1058:ll_file_open()) START file d77r.sanityn:[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags 704400 00000002:00010000:0.0:1783145950.677753:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2000013a1:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0100240704401 00010000:00010000:0.0:1783145950.677773:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.677778:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783145950.677785:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1783145950.677790:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143ce00 x1869755188162304/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1783145950.677795:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.677810:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162304:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.677946:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.678771:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162304:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.678781:0:307651:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678788:0:307651:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678793:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678797:0:307651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678802:0:307651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678805:0:307651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff920e24620800 already unused, calling callback (ffffffffc1b35fa0) 00010000:00010000:0.0:1783145950.678809:0:307651:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678813:0:307651:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678817:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678822:0:307651:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783145950.678831:0:307651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.678835:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.678845:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff920e4143ce00 x1869755188162304/t12884905775(12884905775) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 648/664 e 0 to 0 dl 1783146131 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1783145950.678853:0:307651:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff920e4143ce00 x1869755188162304/t12884905775(12884905775) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 648/664 e 0 to 0 dl 1783146131 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1783145950.678862:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1783145950.678870:0:307651:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x2000013a1:0x25:0x0], updating i_size 4096 00000002:00100000:0.0:1783145950.678879:0:307651:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff920e4143ce00 x1869755188162304/t12884905775(12884905775) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 520/664 e 0 to 0 dl 1783146131 ref 2 fl Complete:RPQU/604/0 rc 301/301 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1783145950.678923:0:307651:0:(file.c:6217:ll_getattr_dentry()) START file d77r.sanityn:[0x2000013a1:0x25:0x0](ffff920e1d2d0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1783145950.678927:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908),name=d77r.sanityn 00000002:00010000:0.0:1783145950.678934:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2000013a1:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.678940:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.678947:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.678951:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145950.678953:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00000080:00010000:0.0:1783145950.678955:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a1:0x25:0x0](ffff920e1d2d0908) for lock 0x91d81fafb679b8cc 00000080:00010000:0.0:1783145950.678957:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8cc from it ffffb82641c3bcd8 00010000:00010000:0.0:1783145950.678963:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.678968:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1783145950.679002:0:307651:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) pos/size0/4096 32bit_api 0 00000002:00010000:0.0:1783145950.679033:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2000013a1:0x25:0x0]) in obj [0x2000013a1:0x25:0x0], intent: readdir flags 0 00010000:00010000:0.0:1783145950.679039:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.679045:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1783145950.679524:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162432:192.168.203.144@tcp:37:rm.0 00000100:00100000:0.0:1783145950.679562:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783145950.682059:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162432:192.168.203.144@tcp:37:rm.0 00010000:00010000:0.0:1783145950.682541:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.682549:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200008:0.0:1783145950.682618:0:307651:0:(file.c:447:ll_file_release()) START file d77r.sanityn:[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags 704000 00000002:00100000:0.0:1783145950.682650:0:307651:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff920e4143ce00 x1869755188162304/t12884905775(12884905775) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 520/664 e 0 to 0 dl 1783146131 ref 1 fl Complete:RPQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1783145950.682657:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1783145950.682667:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143f480 x1869755188162688/t0(0) o35->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1783145950.682677:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162688:192.168.203.144@tcp:35:rm.0 00000100:00100000:0.0:1783145950.682711:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783145950.683445:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162688:192.168.203.144@tcp:35:rm.0 00000002:00100000:0.0:1783145950.683457:0:307651:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff920e4143ce00 x1869755188162304/t12884905775(12884905775) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 520/664 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/604/ffffffff rc 301/-1 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1783145950.683508:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145950.683520:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.683529:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.683538:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.683546:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145950.683549:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145950.683551:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb6793466 00000080:00010000:0.0:1783145950.683555:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb6793466 from it ffffb82641c3bbf8 00010000:00010000:0.0:1783145950.683557:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.683562:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.683568:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.683577:0:307651:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=266 00000080:00200000:0.0:1783145950.683580:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 44 00000080:00200008:0.0:1783145950.683585:0:307651:0:(file.c:1058:ll_file_open()) START file d77r.sanityn:[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags 704400 00000002:00010000:0.0:1783145950.683594:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2000013a1:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0104240704401 00010000:00010000:0.0:1783145950.683616:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.683621:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1783145950.683627:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1783145950.683630:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143f480 x1869755188162944/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 648/131856 e 0 to 0 dl 0 ref 1 fl New:PQU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00010000:00010000:0.0:1783145950.683635:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.683642:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162944:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.683727:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.684627:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188162944:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.684641:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.684648:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.684656:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 4/1,0 mode: CR/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.684671:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 4/1,0 mode: CR/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.684679:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@ffff920e4143f480 x1869755188162944/t12884905777(12884905777) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 648/664 e 0 to 0 dl 1783146131 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00100000:0.0:1783145950.684687:0:307651:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff920e4143f480 x1869755188162944/t12884905777(12884905777) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 648/664 e 0 to 0 dl 1783146131 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.684696:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.684702:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 16 res 8589939617/37 (0 0) 00000080:00200000:0.0:1783145950.684705:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 1 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:0.0:1783145950.684718:0:307651:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x2000013a1:0x25:0x0], updating i_size 4096 00000080:00010000:0.0:1783145950.684722:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a1:0x25:0x0](ffff920e1d2d0908) for lock 0x91d81fafb679b8da 00000080:00010000:0.0:1783145950.684726:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8da from it ffffb82641c3bbd0 00010000:00010000:0.0:1783145950.684728:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.684736:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00100000:0.0:1783145950.684753:0:307651:0:(mdc_request.c:811:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff920e4143f480 x1869755188162944/t12884905777(12884905777) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 520/664 e 0 to 0 dl 1783146131 ref 2 fl Complete:RPQU/604/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000080:00200008:0.0:1783145950.684796:0:307651:0:(file.c:6217:ll_getattr_dentry()) START file d77r.sanityn:[0x2000013a1:0x25:0x0](ffff920e1d2d0908), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1783145950.684800:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908),name=d77r.sanityn 00000002:00010000:0.0:1783145950.684814:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x2000013a1:0x25:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.684819:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1783145950.684826:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1783145950.684831:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145950.684835:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00000080:00010000:0.0:1783145950.684838:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a1:0x25:0x0](ffff920e1d2d0908) for lock 0x91d81fafb679b8cc 00000080:00010000:0.0:1783145950.684842:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8cc from it ffffb82641c3bcd8 00010000:00010000:0.0:1783145950.684845:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1783145950.684852:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1783145950.684907:0:307651:0:(llite_lib.c:2774:ll_statfs()) VFS Op:sb=lustre (ffff920e0f1b0800) d77r.sanityn proj=0 00000080:00000004:0.0:1783145950.684913:0:307651:0:(obd_class.h:1091:obd_statfs()) lustre-clilmv-ffff920e0f1b0800: age 8463, max_age 8601 00800000:00000004:0.0:1783145950.684922:0:307651:0:(obd_class.h:1091:obd_statfs()) lustre-MDT0000-mdc-ffff920e0f1b0800: age 8463, max_age 8601 00000100:00100000:0.0:1783145950.684937:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163072:192.168.203.144@tcp:41:rm.0 00000100:00100000:0.0:1783145950.684970:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.685696:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163072:192.168.203.144@tcp:41:rm.0 00800000:00000004:0.0:1783145950.685705:0:307651:0:(obd_class.h:1117:obd_statfs()) lustre-MDT0000-mdc-ffff920e0f1b0800: update ffff920e128a37d0 cache blocks 1789952/1916558 objects 519453/534171 00000080:00000004:0.0:1783145950.685708:0:307651:0:(obd_class.h:1117:obd_statfs()) lustre-clilmv-ffff920e0f1b0800: update ffff920e128a0450 cache blocks 1789952/1916558 objects 519453/534171 00000080:00000004:0.0:1783145950.685711:0:307651:0:(llite_lib.c:2626:ll_statfs_internal()) MDC blocks 1789952/1916558 objects 519453/534171 00000080:00200000:0.0:1783145950.685723:0:307651:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) pos/size0/4096 32bit_api 0 00000080:00200000:0.0:1783145950.685757:0:307651:0:(dir.c:332:ll_iterate()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:0.0:1783145950.685770:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.685779:0:307651:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-08, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags=0 00000080:00200000:0.0:1783145950.685782:0:307651:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-08, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), intent=getattr 00000002:00010000:0.0:1783145950.685791:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-08,[0x0:0x0:0x0]) in obj [0x2000013a1:0x25:0x0], intent: getattr flags 01 00010000:00010000:0.0:1783145950.685808:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.685813:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.685818:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.685825:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163200:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.685853:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.686901:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163200:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.686910:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686920:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686925:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686930:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686943:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686949:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686954:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686958:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.686963:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143ce00 x1869755188163200/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/640 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.686969:0:307651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1783145950.686975:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.686980:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939619/450 (0 0) 00000080:00200000:0.0:1783145950.686982:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x2000013a1:0x25:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1783145950.687002:0:307651:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a3:0x1c2:0x0](ffff920e326242c8) 00000080:00200000:0.0:1783145950.687122:0:307651:0:(file.c:6749:ll_layout_conf()) [0x2000013a3:0x1c2:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1783145950.687129:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a3:0x1c2:0x0](ffff920e326242c8) for lock 0x91d81fafb679b8e1 00000080:00010000:0.0:1783145950.687134:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a3:0x1c2:0x0](ffff920e326242c8) 00000080:00010000:0.0:1783145950.687140:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8e1 from it ffffb82641c3bdf8 00010000:00010000:0.0:1783145950.687142:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.687148:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.687160:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.687164:0:307651:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-08, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00010000:00010000:0.0:1783145950.687188:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1783145950.687200:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e18182e00/0x91d81fafb6793474 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877cb5 expref: -99 pid: 303204 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.687246:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.687259:0:307651:0:(vvp_object.c:117:vvp_conf_set()) [0x2000013a3:0x1c2:0x0]: losing layout lock 00010000:00010000:0.0:1783145950.687279:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.687284:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 1/0,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1783145950.687287:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1783145950.687289:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620c00/0x91d81fafb679b8e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895bcc expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.687307:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8cc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366895b8d expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000020:00100000:0.0:1783145950.687317:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.687321:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143ce00 x1869755188163456/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.687330:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163456:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.687358:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.688688:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ce00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163456:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.688724:0:307651:0:(vvp_io.c:1822:vvp_io_init()) [0x2000013a3:0x1c2:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1783145950.688736:0:307651:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1783145950.688782:0:307651:0:(vvp_io.c:304:vvp_io_fini()) [0x2000013a3:0x1c2:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1783145950.688794:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a3:0x1c2:0x0](ffff920e326242c8) 00000080:00200000:0.0:1783145950.688846:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.688854:0:307651:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-07, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags=0 00000080:00200000:0.0:1783145950.688856:0:307651:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-07, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), intent=getattr 00000002:00010000:0.0:1783145950.688865:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-07,[0x0:0x0:0x0]) in obj [0x2000013a1:0x25:0x0], intent: getattr flags 01 00010000:00010000:0.0:1783145950.688884:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.688890:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.688896:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.688912:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143f800 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163584:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.688945:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.689990:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143f800 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163584:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.690000:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690038:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690047:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690057:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690065:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690075:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690083:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690091:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.690112:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143f800 x1869755188163584/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/640 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.690123:0:307651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1783145950.690133:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690143:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939619/447 (0 0) 00000080:00200000:0.0:1783145950.690147:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x2000013a1:0x25:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1783145950.690165:0:307651:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a3:0x1bf:0x0](ffff920e326221c8) 00000080:00200000:0.0:1783145950.690214:0:307651:0:(file.c:6749:ll_layout_conf()) [0x2000013a3:0x1bf:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1783145950.690223:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a3:0x1bf:0x0](ffff920e326221c8) for lock 0x91d81fafb679b8e8 00000080:00010000:0.0:1783145950.690229:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a3:0x1bf:0x0](ffff920e326221c8) 00000080:00010000:0.0:1783145950.690232:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8e8 from it ffffb82641c3bdf8 00010000:00010000:0.0:1783145950.690235:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.690244:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.690258:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.690261:0:307651:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-07, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00010000:00010000:0.0:1783145950.690279:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.690299:0:307651:0:(vvp_object.c:117:vvp_conf_set()) [0x2000013a3:0x1bf:0x0]: losing layout lock 00010000:00010000:0.0:1783145950.690315:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.690320:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.690322:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8e8 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895c04 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1783145950.690332:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.690336:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143f800 x1869755188163840/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.690345:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143f800 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163840:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.690372:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:2.0F:1783145950.691185:0:2402:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.144@tcp (source: 12345-192.168.203.144@tcp) 00000100:00100000:3.0:1783145950.691243:0:289865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755178681216 00000100:00100000:3.0:1783145950.691250:0:289865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755178681216 00000100:00100000:3.0:1783145950.691303:0:289865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.144@tcp, seq: 924 00000100:00100000:3.0:1783145950.691315:0:289865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff920e0e4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:b832727d-edc7-457c-aba4-c59935e6a58f+5:204555:x1869755178681216:12345-192.168.203.144@tcp:104: 00010000:00010000:3.0:1783145950.691329:0:289865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1783145950.691378:0:289865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783145950.691385:0:289865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff920e0e4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:b832727d-edc7-457c-aba4-c59935e6a58f+5:204555:x1869755178681216:12345-192.168.203.144@tcp:104: Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783145950.691393:0:289865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.144@tcp, seq: 924 00010000:00010000:0.0:1783145950.691396:0:305427:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783145950.691403:0:305427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.691410:0:305427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff920e390d0800 already unused, calling callback (ffffffffc1b35fa0) 00010000:00010000:0.0:1783145950.691413:0:305427:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.691422:0:305427:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.691431:0:305427:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.691461:0:305427:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e03503800/0x91d81fafb679b7de lrc: 2/0,0 mode: CR/CR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee36689572d expref: -99 pid: 306345 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1783145950.691512:0:305427:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.691520:0:305427:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.691546:0:305427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.691554:0:305427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d0800/0x91d81fafb679b855 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1bf:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee366895964 expref: -99 pid: 306357 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.691570:0:305427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783145950.691572:0:305427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783145950.691575:0:305427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783145950.691580:0:2408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b832727d-edc7-457c-aba4-c59935e6a58f:2408:1869755188163968:192.168.203.144@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1783145950.692322:0:2408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b832727d-edc7-457c-aba4-c59935e6a58f:2408:1869755188163968:192.168.203.144@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783145950.692863:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143f800 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188163840:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.692890:0:307651:0:(vvp_io.c:1822:vvp_io_init()) [0x2000013a3:0x1bf:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1783145950.692896:0:307651:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1783145950.692922:0:307651:0:(vvp_io.c:304:vvp_io_fini()) [0x2000013a3:0x1bf:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1783145950.692930:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a3:0x1bf:0x0](ffff920e326221c8) 00000080:00200000:0.0:1783145950.692969:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.692977:0:307651:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-13, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags=0 00000080:00200000:0.0:1783145950.692979:0:307651:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-13, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), intent=getattr 00000002:00010000:0.0:1783145950.692989:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-13,[0x0:0x0:0x0]) in obj [0x2000013a1:0x25:0x0], intent: getattr flags 01 00010000:00010000:0.0:1783145950.693006:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.693068:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.693075:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.693086:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143e300 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164096:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.693119:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.694096:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143e300 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164096:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.694104:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694114:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694119:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694125:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694130:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694135:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694148:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694152:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.694159:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143e300 x1869755188164096/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/640 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.694165:0:307651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1783145950.694171:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694177:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939619/452 (0 0) 00000080:00200000:0.0:1783145950.694180:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x2000013a1:0x25:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1783145950.694193:0:307651:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a3:0x1c4:0x0](ffff920e32622a08) 00000080:00200000:0.0:1783145950.694238:0:307651:0:(file.c:6749:ll_layout_conf()) [0x2000013a3:0x1c4:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1783145950.694245:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a3:0x1c4:0x0](ffff920e32622a08) for lock 0x91d81fafb679b8ef 00000080:00010000:0.0:1783145950.694250:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a3:0x1c4:0x0](ffff920e32622a08) 00000080:00010000:0.0:1783145950.694252:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8ef from it ffffb82641c3bdf8 00010000:00010000:0.0:1783145950.694254:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.694259:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.694279:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.694283:0:307651:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-13, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00010000:00010000:0.0:1783145950.694302:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.694313:0:307651:0:(vvp_object.c:117:vvp_conf_set()) [0x2000013a3:0x1c4:0x0]: losing layout lock 00010000:00010000:0.0:1783145950.694328:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.694333:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.694335:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b8ef lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895c3c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1783145950.694346:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.694350:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143e300 x1869755188164352/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.694359:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143e300 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164352:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.694384:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.695549:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143e300 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164352:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.695572:0:307651:0:(vvp_io.c:1822:vvp_io_init()) [0x2000013a3:0x1c4:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1783145950.695577:0:307651:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1783145950.695595:0:307651:0:(vvp_io.c:304:vvp_io_fini()) [0x2000013a3:0x1c4:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1783145950.695602:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a3:0x1c4:0x0](ffff920e32622a08) 00000080:00200000:0.0:1783145950.695643:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.695650:0:307651:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-11, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags=0 00000080:00200000:0.0:1783145950.695657:0:307651:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-11, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), intent=getattr 00000002:00010000:0.0:1783145950.695664:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-11,[0x0:0x0:0x0]) in obj [0x2000013a1:0x25:0x0], intent: getattr flags 01 00010000:00010000:0.0:1783145950.695681:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.695686:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.695691:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.695698:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143c000 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164480:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.695723:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.696694:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143c000 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164480:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.696703:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696715:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696723:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696737:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696746:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696767:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696775:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696783:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.696793:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143c000 x1869755188164480/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/640 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.696803:0:307651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1783145950.696814:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696823:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939619/449 (0 0) 00000080:00200000:0.0:1783145950.696827:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x2000013a1:0x25:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1783145950.696844:0:307651:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a3:0x1c1:0x0](ffff920e32621988) 00000080:00200000:0.0:1783145950.696899:0:307651:0:(file.c:6749:ll_layout_conf()) [0x2000013a3:0x1c1:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1783145950.696910:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a3:0x1c1:0x0](ffff920e32621988) for lock 0x91d81fafb679b8f6 00000080:00010000:0.0:1783145950.696916:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a3:0x1c1:0x0](ffff920e32621988) 00000080:00010000:0.0:1783145950.696919:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8f6 from it ffffb82641c3bdf8 00010000:00010000:0.0:1783145950.696922:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.696943:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.696960:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.696964:0:307651:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-11, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00010000:00010000:0.0:1783145950.696985:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.696996:0:307651:0:(vvp_object.c:117:vvp_conf_set()) [0x2000013a3:0x1c1:0x0]: losing layout lock 00010000:00010000:0.0:1783145950.697046:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.697051:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.697053:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b8f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895c74 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1783145950.697064:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.697067:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143c000 x1869755188164736/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.697076:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143c000 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164736:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.697101:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:2.0:1783145950.697928:0:2402:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.144@tcp (source: 12345-192.168.203.144@tcp) 00000100:00100000:3.0:1783145950.697967:0:289337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755178681344 00000100:00100000:3.0:1783145950.697972:0:289337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755178681344 00000100:00100000:3.0:1783145950.698004:0:289337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.144@tcp, seq: 925 00000100:00100000:3.0:1783145950.698039:0:289337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff920e0e4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:b832727d-edc7-457c-aba4-c59935e6a58f+5:206077:x1869755178681344:12345-192.168.203.144@tcp:104: 00010000:00010000:3.0:1783145950.698052:0:289337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1783145950.698102:0:289337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783145950.698109:0:289337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff920e0e4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:b832727d-edc7-457c-aba4-c59935e6a58f+5:206077:x1869755178681344:12345-192.168.203.144@tcp:104: Request processed in 98us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783145950.698118:0:289337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.144@tcp, seq: 925 00010000:00010000:0.0:1783145950.698128:0:289344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783145950.698134:0:289344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.698142:0:289344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff920e390d1e00 already unused, calling callback (ffffffffc1b35fa0) 00010000:00010000:0.0:1783145950.698152:0:289344:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.698161:0:289344:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.698170:0:289344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.698190:0:289344:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e10304c00/0x91d81fafb679b801 lrc: 2/0,0 mode: CR/CR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee3668957f1 expref: -99 pid: 306353 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1783145950.698229:0:289344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.698234:0:289344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.698253:0:289344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.698259:0:289344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1e00/0x91d81fafb679b85c lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c1:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee36689598e expref: -99 pid: 306359 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00000100:00100000:1.0:1783145950.698272:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188164864:192.168.203.144@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783145950.698274:0:289344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783145950.698277:0:289344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783145950.698279:0:289344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783145950.699019:0:2407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188164864:192.168.203.144@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783145950.699513:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143c000 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164736:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.699558:0:307651:0:(vvp_io.c:1822:vvp_io_init()) [0x2000013a3:0x1c1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1783145950.699566:0:307651:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1783145950.699612:0:307651:0:(vvp_io.c:304:vvp_io_fini()) [0x2000013a3:0x1c1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1783145950.699623:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a3:0x1c1:0x0](ffff920e32621988) 00000080:00200000:0.0:1783145950.699690:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.699704:0:307651:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-12, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags=0 00000080:00200000:0.0:1783145950.699708:0:307651:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-12, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), intent=getattr 00000002:00010000:0.0:1783145950.699723:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-12,[0x0:0x0:0x0]) in obj [0x2000013a1:0x25:0x0], intent: getattr flags 01 00010000:00010000:0.0:1783145950.699752:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.699761:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.699770:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.699782:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143df80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164992:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.699815:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.700801:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143df80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188164992:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.700814:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700826:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700831:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700836:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700848:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700855:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700860:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700865:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.700871:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143df80 x1869755188164992/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/640 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.700878:0:307651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1783145950.700885:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700891:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939619/453 (0 0) 00000080:00200000:0.0:1783145950.700894:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x2000013a1:0x25:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1783145950.700909:0:307651:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a3:0x1c5:0x0](ffff920e326242c8) 00000080:00200000:0.0:1783145950.700956:0:307651:0:(file.c:6749:ll_layout_conf()) [0x2000013a3:0x1c5:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1783145950.700963:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a3:0x1c5:0x0](ffff920e326242c8) for lock 0x91d81fafb679b8fd 00000080:00010000:0.0:1783145950.700968:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a3:0x1c5:0x0](ffff920e326242c8) 00000080:00010000:0.0:1783145950.700974:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b8fd from it ffffb82641c3bdf8 00010000:00010000:0.0:1783145950.700977:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.700982:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.700995:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.700999:0:307651:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-12, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00010000:00010000:0.0:1783145950.701056:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.701069:0:307651:0:(vvp_object.c:117:vvp_conf_set()) [0x2000013a3:0x1c5:0x0]: losing layout lock 00010000:00010000:0.0:1783145950.701085:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.701090:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.701091:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621400/0x91d81fafb679b8fd lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895cac expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1783145950.701103:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.701108:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143df80 x1869755188165248/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.701116:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143df80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165248:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.701142:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.702358:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143df80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165248:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.702384:0:307651:0:(vvp_io.c:1822:vvp_io_init()) [0x2000013a3:0x1c5:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1783145950.702395:0:307651:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1783145950.702429:0:307651:0:(vvp_io.c:304:vvp_io_fini()) [0x2000013a3:0x1c5:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1783145950.702436:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a3:0x1c5:0x0](ffff920e326242c8) 00000080:00200000:0.0:1783145950.702479:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.702491:0:307651:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-14, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags=0 00000080:00200000:0.0:1783145950.702508:0:307651:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-14, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), intent=getattr 00000002:00010000:0.0:1783145950.702519:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-14,[0x0:0x0:0x0]) in obj [0x2000013a1:0x25:0x0], intent: getattr flags 01 00010000:00010000:0.0:1783145950.702538:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.702543:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.702548:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.702556:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ca80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165376:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.702582:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.703621:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ca80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165376:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.703633:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703643:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703648:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703660:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703666:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703672:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703677:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703681:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.703687:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143ca80 x1869755188165376/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/640 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.703693:0:307651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1783145950.703698:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703704:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939619/454 (0 0) 00000080:00200000:0.0:1783145950.703707:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x2000013a1:0x25:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1783145950.703717:0:307651:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a3:0x1c6:0x0](ffff920e32622a08) 00000080:00200000:0.0:1783145950.703780:0:307651:0:(file.c:6749:ll_layout_conf()) [0x2000013a3:0x1c6:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1783145950.703788:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a3:0x1c6:0x0](ffff920e32622a08) for lock 0x91d81fafb679b904 00000080:00010000:0.0:1783145950.703793:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a3:0x1c6:0x0](ffff920e32622a08) 00000080:00010000:0.0:1783145950.703795:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b904 from it ffffb82641c3bdf8 00010000:00010000:0.0:1783145950.703797:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.703803:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.703815:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.703819:0:307651:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-14, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00010000:00010000:0.0:1783145950.703836:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.703847:0:307651:0:(vvp_object.c:117:vvp_conf_set()) [0x2000013a3:0x1c6:0x0]: losing layout lock 00010000:00010000:0.0:1783145950.703862:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.703867:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.703869:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620800/0x91d81fafb679b904 lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895ce4 expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1783145950.703880:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.703884:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143ca80 x1869755188165632/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.703892:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ca80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165632:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.703917:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.705332:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ca80 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165632:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.705366:0:307651:0:(vvp_io.c:1822:vvp_io_init()) [0x2000013a3:0x1c6:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1783145950.705371:0:307651:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1783145950.705394:0:307651:0:(vvp_io.c:304:vvp_io_fini()) [0x2000013a3:0x1c6:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1783145950.705402:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a3:0x1c6:0x0](ffff920e32622a08) 00000080:00200000:0.0:1783145950.705461:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.705473:0:307651:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=f77r.sanityn-09, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags=0 00000080:00200000:0.0:1783145950.705477:0:307651:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=f77r.sanityn-09, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), intent=getattr 00000002:00010000:0.0:1783145950.705488:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-09,[0x0:0x0:0x0]) in obj [0x2000013a1:0x25:0x0], intent: getattr flags 01 00010000:00010000:0.0:1783145950.705523:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.705529:0:307651:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.705534:0:307651:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 307651 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783145950.705542:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143c700 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165760:192.168.203.144@tcp:101:rm.0 00000100:00100000:0.0:1783145950.705568:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:0.0:1783145950.706560:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143c700 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188165760:192.168.203.144@tcp:101:rm.0 00010000:00010000:0.0:1783145950.706568:0:307651:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 4/1,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706578:0:307651:0:(ldlm_request.c:774:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706590:0:307651:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 4/1,0 mode: --/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706605:0:307651:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706612:0:307651:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706618:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706623:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 5/2,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706628:0:307651:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 4/1,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145950.706634:0:307651:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e4143c700 x1869755188165760/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/640 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0 00000002:00010000:0.0:1783145950.706639:0:307651:0:(mdc_locks.c:937:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1783145950.706645:0:307651:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706651:0:307651:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589939619/451 (0 0) 00000080:00200000:0.0:1783145950.706654:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x2000013a1:0x25:0x0] suppgids 0 -1: rc 0 00000080:00200000:0.0:1783145950.706669:0:307651:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a3:0x1c3:0x0](ffff920e32621988) 00000080:00200000:0.0:1783145950.706715:0:307651:0:(file.c:6749:ll_layout_conf()) [0x2000013a3:0x1c3:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1783145950.706721:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x2000013a3:0x1c3:0x0](ffff920e32621988) for lock 0x91d81fafb679b90b 00000080:00010000:0.0:1783145950.706726:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x2000013a3:0x1c3:0x0](ffff920e32621988) 00000080:00010000:0.0:1783145950.706728:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b90b from it ffffb82641c3bdf8 00010000:00010000:0.0:1783145950.706731:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 3/1,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145950.706736:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.706748:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.706751:0:307651:0:(namei.c:2407:ll_unlink()) VFS Op:name=f77r.sanityn-09, dir=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00010000:00010000:0.0:1783145950.706769:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1783145950.706780:0:307651:0:(vvp_object.c:117:vvp_conf_set()) [0x2000013a3:0x1c3:0x0]: losing layout lock 00010000:00010000:0.0:1783145950.706796:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145950.706800:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.706802:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24621200/0x91d81fafb679b90b lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x38bddee366895d1c expref: -99 pid: 307651 timeout: 0 lvb_type: 3 lru_score: 1 lru_type: 0 00000020:00100000:0.0:1783145950.706813:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.706817:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143c700 x1869755188166016/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.706826:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143c700 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188166016:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.706851:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2f00 going to sleep for 176 seconds 00000100:00100000:2.0:1783145950.707648:0:2402:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.144@tcp (source: 12345-192.168.203.144@tcp) 00000100:00100000:3.0:1783145950.707687:0:289865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755178681472 00000100:00100000:3.0:1783145950.707693:0:289865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755178681472 00000100:00100000:3.0:1783145950.707734:0:289865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.144@tcp, seq: 926 00000100:00100000:3.0:1783145950.707743:0:289865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff920e0e4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:b832727d-edc7-457c-aba4-c59935e6a58f+5:206077:x1869755178681472:12345-192.168.203.144@tcp:104: 00010000:00010000:3.0:1783145950.707757:0:289865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1783145950.707810:0:289865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783145950.707817:0:289865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff920e0e4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:b832727d-edc7-457c-aba4-c59935e6a58f+5:206077:x1869755178681472:12345-192.168.203.144@tcp:104: Request processed in 75us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783145950.707825:0:289865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.144@tcp, seq: 926 00010000:00010000:0.0:1783145950.707830:0:289345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783145950.707837:0:289345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.707845:0:289345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff920e390d1000 already unused, calling callback (ffffffffc1b35fa0) 00010000:00010000:0.0:1783145950.707849:0:289345:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.707859:0:289345:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 2/0,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.707868:0:289345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 3/0,0 mode: PR/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.707887:0:289345:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1c00/0x91d81fafb679b847 lrc: 2/0,0 mode: CR/CR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x38bddee36689592c expref: -99 pid: 306351 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1783145950.707929:0:289345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 2/0,0 mode: --/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.707937:0:289345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145950.707963:0:289345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 1/0,0 mode: --/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.707972:0:289345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d1000/0x91d81fafb679b89b lrc: 0/0,0 mode: --/PR res: [0x2000013a3:0x1c3:0x0].0x0 bits 0x1b/0x1b rrc: 3 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0x38bddee366895a59 expref: -99 pid: 306365 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.707986:0:289345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783145950.707989:0:289345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783145950.707990:0:2408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b832727d-edc7-457c-aba4-c59935e6a58f:2408:1869755188166144:192.168.203.144@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783145950.707998:0:289345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783145950.708878:0:2408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b832727d-edc7-457c-aba4-c59935e6a58f:2408:1869755188166144:192.168.203.144@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783145950.709368:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143c700 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188166016:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.709411:0:307651:0:(vvp_io.c:1822:vvp_io_init()) [0x2000013a3:0x1c3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1783145950.709419:0:307651:0:(lov_io.c:1086:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1783145950.709460:0:307651:0:(vvp_io.c:304:vvp_io_fini()) [0x2000013a3:0x1c3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:0.0:1783145950.709473:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a3:0x1c3:0x0](ffff920e32621988) 00000080:00200008:0.0:1783145950.709553:0:307651:0:(file.c:447:ll_file_release()) START file d77r.sanityn:[0x2000013a1:0x25:0x0](ffff920e1d2d0908), flags 704000 00010000:00010000:0.0:1783145950.709570:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1783145950.709604:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145950.709616:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.709624:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.709634:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.709642:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145950.709646:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145950.709650:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb6793466 00000080:00010000:0.0:1783145950.709655:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb6793466 from it ffffb82641c3bc10 00010000:00010000:0.0:1783145950.709659:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.709667:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.709690:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 1 00000080:00200000:0.0:1783145950.709698:0:307651:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=0 00000080:00200000:0.0:1783145950.709703:0:307651:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145950.709709:0:307651:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145950.709716:0:307651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.709726:0:307651:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.709733:0:307651:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145950.709736:0:307651:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145950.709739:0:307651:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb6793466 00000080:00010000:0.0:1783145950.709743:0:307651:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb6793466 from it ffffb82641c3bd88 00010000:00010000:0.0:1783145950.709746:0:307651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.709754:0:307651:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000080:00200000:0.0:1783145950.709763:0:307651:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 3 00000080:00200000:0.0:1783145950.709768:0:307651:0:(namei.c:2317:ll_rmdir()) VFS Op:name=d77r.sanityn, dir=[0x200000007:0x1:0x0](ffff920e27be80c8) 00010000:00010000:0.0:1783145950.709780:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.709798:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000002:00100000:0.0:1783145950.709845:0:307651:0:(mdc_request.c:964:mdc_close()) @@@ matched open req@ffff920e4143f480 x1869755188162944/t12884905777(12884905777) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 520/664 e 0 to 0 dl 1783146131 ref 1 fl Complete:RPQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00000020:00100000:0.0:1783145950.709855:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1783145950.709860:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143ea00 x1869755188166400/t0(0) o35->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/400/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:0 00000100:00100000:0.0:1783145950.709874:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ea00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188166400:192.168.203.144@tcp:35:rm.0 00000100:00100000:0.0:1783145950.709914:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783145950.710622:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ea00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188166400:192.168.203.144@tcp:35:rm.0 00000002:00100000:0.0:1783145950.710635:0:307651:0:(mdc_request.c:832:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff920e4143f480 x1869755188162944/t12884905777(12884905777) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 520/664 e 0 to 0 dl 1783146131 ref 1 fl Complete:RQU/604/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1783145950.710656:0:307651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e18182e00/0x91d81fafb6793474 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x38bddee366877cb5 expref: -99 pid: 303204 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.710673:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 1/0,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.710678:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e18182e00/0x91d81fafb6793474 lrc: 1/0,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366877cb5 expref: -99 pid: 303204 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.710683:0:307651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:0.0:1783145950.710686:0:307651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1783145950.710687:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e24620400/0x91d81fafb679b8da lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x25:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366895ba9 expref: -99 pid: 307651 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.710702:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e18182e00/0x91d81fafb6793474 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366877cb5 expref: -99 pid: 303204 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145950.710711:0:307651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e390d1600/0x91d81fafb6793466 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366877c76 expref: -99 pid: 303191 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00000020:00100000:0.0:1783145950.710723:0:307651:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145950.710726:0:307651:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143ea00 x1869755188166656/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145950.710736:0:307651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ea00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188166656:192.168.203.144@tcp:36:rm.0 00000100:00100000:0.0:1783145950.710761:0:307651:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2480 going to sleep for 176 seconds 00000100:00100000:3.0:1783145950.711467:0:2402:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.144@tcp (source: 12345-192.168.203.144@tcp) 00000100:00100000:2.0:1783145950.711535:0:289337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755178681600 00000100:00100000:2.0:1783145950.711541:0:289337:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755178681600 00000100:00100000:2.0:1783145950.711580:0:289337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.144@tcp, seq: 927 00000100:00100000:2.0:1783145950.711590:0:289337:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff920e41414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:b832727d-edc7-457c-aba4-c59935e6a58f+5:204556:x1869755178681600:12345-192.168.203.144@tcp:104: 00010000:00010000:2.0:1783145950.711602:0:289337:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:2.0:1783145950.711649:0:289337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783145950.711656:0:289337:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff920e41414e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:b832727d-edc7-457c-aba4-c59935e6a58f+5:204556:x1869755178681600:12345-192.168.203.144@tcp:104: Request processed in 68us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783145950.711663:0:289337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.144@tcp, seq: 927 00010000:00010000:1.0:1783145950.711680:0:293257:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783145950.711686:0:293257:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1783145950.711698:0:293257:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff920e390d8400 already unused, calling callback (ffffffffc1b35fa0) 00010000:00010000:1.0:1783145950.711701:0:293257:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1783145950.711708:0:293257:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1783145950.711714:0:293257:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1783145950.711736:0:293257:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1783145950.711740:0:293257:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783145950.711763:0:293257:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1783145950.711768:0:293257:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8400/0x91d81fafb67936ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x38bddee3668783ca expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 254 lru_type: 1 00010000:00010000:1.0:1783145950.711781:0:293257:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783145950.711782:0:293257:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783145950.711785:0:293257:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783145950.711785:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e1012a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188166784:192.168.203.144@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783145950.712453:0:2407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e1012a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188166784:192.168.203.144@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783145950.712689:0:2402:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.144@tcp (source: 12345-192.168.203.144@tcp) 00000100:00100000:2.0:1783145950.712731:0:289865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869755178681728 00000100:00100000:2.0:1783145950.712736:0:289865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869755178681728 00000100:00100000:2.0:1783145950.712764:0:289865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.144@tcp, seq: 928 00000100:00100000:2.0:1783145950.712773:0:289865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff920e41415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:b832727d-edc7-457c-aba4-c59935e6a58f+5:204556:x1869755178681728:12345-192.168.203.144@tcp:104: 00010000:00010000:2.0:1783145950.712782:0:289865:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1783145950.712820:0:289865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783145950.712826:0:289865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff920e41415500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:b832727d-edc7-457c-aba4-c59935e6a58f+5:204556:x1869755178681728:12345-192.168.203.144@tcp:104: Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783145950.712833:0:289865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.144@tcp, seq: 928 00010000:00010000:1.0:1783145950.712838:0:289866:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783145950.712843:0:289866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1783145950.712850:0:289866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff920e390d8800 already unused, calling callback (ffffffffc1b35fa0) 00010000:00010000:1.0:1783145950.712854:0:289866:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1783145950.712859:0:289866:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1783145950.712865:0:289866:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1783145950.712885:0:289866:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1783145950.712889:0:289866:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783145950.712904:0:289866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 1/0,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1783145950.712918:0:289866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f130800 lock: ffff920e390d8800/0x91d81fafb67936b2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x25:0x0].0x0 bits 0x11/0x11 rrc: 3 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0x38bddee3668783e6 expref: -99 pid: 303264 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1783145950.712926:0:2408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e10128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b832727d-edc7-457c-aba4-c59935e6a58f:2408:1869755188166912:192.168.203.144@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783145950.712927:0:289866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783145950.712930:0:289866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783145950.712932:0:289866:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783145950.713697:0:2408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e10128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b832727d-edc7-457c-aba4-c59935e6a58f:2408:1869755188166912:192.168.203.144@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783145950.714076:0:307651:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ea00 pname:cluuid:pid:xid:nid:opc:job rm:275b1235-b8f5-4ce3-8a3a-d483c556f740:307651:1869755188166656:192.168.203.144@tcp:36:rm.0 00000080:00200000:0.0:1783145950.714097:0:307651:0:(llite_lib.c:1946:ll_clear_inode()) VFS Op:inode=[0x2000013a1:0x25:0x0](ffff920e1d2d0908) 00000100:00100000:0.0:1783145950.906162:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c27b6ecd-87d1-44b6-96a3-8ed75fd014dd:2407:1869755188167040:192.168.203.144@tcp:400:kworker.0 00000100:00100000:0.0:1783145950.906271:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188167296:192.168.203.144@tcp:400:kworker.0 00000100:00100000:0.0:1783145950.906312:0:2407:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783145950.906326:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:275b1235-b8f5-4ce3-8a3a-d483c556f740:2407:1869755188167168:192.168.203.144@tcp:400:kworker.0 00000100:00100000:0.0:1783145950.906360:0:2407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188167424:192.168.203.144@tcp:400:kworker.0 00000100:00100000:0.0:1783145950.907417:0:2407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c27b6ecd-87d1-44b6-96a3-8ed75fd014dd:2407:1869755188167040:192.168.203.144@tcp:400:kworker.0 00000100:00100000:0.0:1783145950.907434:0:2407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188167296:192.168.203.144@tcp:400:kworker.0 00000100:00100000:0.0:1783145950.907454:0:2407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:275b1235-b8f5-4ce3-8a3a-d483c556f740:2407:1869755188167168:192.168.203.144@tcp:400:kworker.0 00000100:00100000:0.0:1783145950.907463:0:2407:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b832727d-edc7-457c-aba4-c59935e6a58f:2407:1869755188167424:192.168.203.144@tcp:400:kworker.0 00000001:02000400:2.0:1783145951.238970:0:307795:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 77s: Check TBF LRU shrinker ============== 02:19:10 (1783145950) 00000080:00200000:2.0:1783145951.279528:0:307806:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:2.0:1783145951.279552:0:307806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1783145951.279612:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.279622:0:307806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.279632:0:307806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783145951.279657:0:307806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e0e4e8000 pname:cluuid:pid:xid:nid:opc:job lfs:275b1235-b8f5-4ce3-8a3a-d483c556f740:307806:1869755188167552:192.168.203.144@tcp:101:lfs.0 00000100:00100000:2.0:1783145951.279731:0:307806:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e408d5f00 going to sleep for 176 seconds 00000100:00100000:2.0:1783145951.280929:0:307806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e0e4e8000 pname:cluuid:pid:xid:nid:opc:job lfs:275b1235-b8f5-4ce3-8a3a-d483c556f740:307806:1869755188167552:192.168.203.144@tcp:101:lfs.0 00010000:00010000:2.0:1783145951.280944:0:307806:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.280955:0:307806:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.280966:0:307806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.280975:0:307806:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.280985:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.280993:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.281026:0:307806:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1783145951.281039:0:307806:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff920e0e4e8000 x1869755188167552/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 576/688 e 0 to 0 dl 1783146132 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000002:00010000:2.0:1783145951.281050:0:307806:0:(mdc_locks.c:1357:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.281060:0:307806:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff920e15947000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1783145951.281065:0:307806:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0 00000080:00200000:2.0:1783145951.281085:0:307806:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 69632 00000080:00010000:2.0:1783145951.281090:0:307806:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb679b912 00000080:00010000:2.0:1783145951.281095:0:307806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:2.0:1783145951.281097:0:307806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b912 from it ffffb82640d53b58 00010000:00010000:2.0:1783145951.281100:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.281108:0:307806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:2.0:1783145951.281125:0:307806:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 1 00000080:00200000:2.0:1783145951.281134:0:307806:0:(namei.c:1335:ll_lookup_nd()) VFS Op:name=d77s.sanityn, dir=[0x200000007:0x1:0x0](ffff920e27be80c8), flags=13 00000080:00200000:2.0:1783145951.281139:0:307806:0:(namei.c:1072:ll_lookup_it()) VFS Op:name=d77s.sanityn, dir=[0x200000007:0x1:0x0](ffff920e27be80c8), intent=getattr 00000002:00010000:2.0:1783145951.281152:0:307806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d77s.sanityn,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 01 00010000:00010000:2.0:1783145951.281172:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.281183:0:307806:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783145951.281190:0:307806:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783145951.281206:0:307806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e0e4e8000 pname:cluuid:pid:xid:nid:opc:job lfs:275b1235-b8f5-4ce3-8a3a-d483c556f740:307806:1869755188167680:192.168.203.144@tcp:101:lfs.0 00000100:00100000:2.0:1783145951.281236:0:307806:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e408d5f00 going to sleep for 176 seconds 00000100:00100000:0.0:1783145951.283977:0:307806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e0e4e8000 pname:cluuid:pid:xid:nid:opc:job lfs:275b1235-b8f5-4ce3-8a3a-d483c556f740:307806:1869755188167680:192.168.203.144@tcp:101:lfs.0 00010000:00010000:0.0:1783145951.283993:0:307806:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284005:0:307806:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284046:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284052:0:307806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284057:0:307806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284062:0:307806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff920e3b366c00 already unused, calling callback (ffffffffc1b35fa0) 00010000:00010000:0.0:1783145951.284065:0:307806:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284078:0:307806:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284083:0:307806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284088:0:307806:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1783145951.284092:0:307806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783145951.284098:0:307806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366c00/0x91d81fafb679b919 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 307806 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1783145951.284112:0:307806:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff920e0e4e8000 x1869755188167680/t0(0) o101->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 584/584 e 0 to 0 dl 1783146132 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0 00000080:00200000:0.0:1783145951.284124:0:307806:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 -1: rc 0 00010000:00010000:0.0:1783145951.284141:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145951.284149:0:307806:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00010000:0.0:1783145951.284154:0:307806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b912 from it ffffb82640d53930 00010000:00010000:0.0:1783145951.284157:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1783145951.284162:0:307806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1783145951.284219:0:307806:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145951.284232:0:307806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145951.284240:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145951.284248:0:307806:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1783145951.284253:0:307806:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145951.284258:0:307806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145951.284260:0:307806:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb679b912 00000080:00010000:0.0:1783145951.284263:0:307806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b912 from it ffffb82640d53be8 00010000:00010000:0.0:1783145951.284265:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1783145951.284270:0:307806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1783145951.284276:0:307806:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 1 00000080:00200000:0.0:1783145951.284280:0:307806:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77s.sanityn, flags=16392 00000080:00200008:0.0:1783145951.284297:0:307806:0:(file.c:6217:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff920e27be80c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1783145951.284300:0:307806:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145951.284305:0:307806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145951.284309:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1783145951.284314:0:307806:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1783145951.284324:0:307806:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145951.284327:0:307806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145951.284329:0:307806:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb679b912 00000080:00010000:0.0:1783145951.284331:0:307806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b912 from it ffffb82640d53cb8 00010000:00010000:0.0:1783145951.284333:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1783145951.284338:0:307806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200008:0.0:1783145951.284773:0:307806:0:(file.c:6217:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff920e27be80c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1783145951.284777:0:307806:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145951.284783:0:307806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145951.284788:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1783145951.284795:0:307806:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1783145951.284799:0:307806:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145951.284803:0:307806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145951.284805:0:307806:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb679b912 00000080:00010000:0.0:1783145951.284808:0:307806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b912 from it ffffb82640d53cb8 00010000:00010000:0.0:1783145951.284811:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1783145951.284830:0:307806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1783145951.284930:0:307806:0:(file.c:6112:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8),name=/ 00000002:00010000:0.0:1783145951.284938:0:307806:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1783145951.284943:0:307806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1783145951.284949:0:307806:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1783145951.284953:0:307806:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1783145951.284957:0:307806:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) 00000080:00010000:0.0:1783145951.284959:0:307806:0:(llite_internal.h:2008:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff920e27be80c8) for lock 0x91d81fafb679b912 00000080:00010000:0.0:1783145951.284961:0:307806:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x91d81fafb679b912 from it ffffb82640d53bb0 00010000:00010000:0.0:1783145951.284963:0:307806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1783145951.284968:0:307806:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000080:00200000:0.0:1783145951.284974:0:307806:0:(file.c:6584:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8), inode mode 41ff mask 44 00000080:00200008:0.0:1783145951.284978:0:307806:0:(file.c:1058:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff920e27be80c8), flags 300000 00000080:00200080:0.0:1783145951.284989:0:307806:0:(dir.c:2003:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8) cmd=c03066f0 arg=7ffc8b47ef00 00000080:00200000:0.0:1783145951.284998:0:307806:0:(dir.c:451:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](ffff920e27be80c8) name=d77s.sanityn stripe_offset=0 stripe_count=1, hash_type=0 00010000:00010000:0.0:1783145951.285053:0:307806:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1783145951.285106:0:307806:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1783145951.285113:0:307806:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783145951.285116:0:307806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff920e0f1b0800 lock: ffff920e3b366e00/0x91d81fafb679b912 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x38bddee366895d5b expref: -99 pid: 307806 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 1 00000020:00100000:0.0:1783145951.285137:0:307806:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff920e0f1b0800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1783145951.285146:0:307806:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff920e4143fb80 x1869755188167936/t0(0) o36->lustre-MDT0000-mdc-ffff920e0f1b0800@192.168.203.144@tcp:12/10 lens 560/576 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783145951.285164:0:307806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff920e4143fb80 pname:cluuid:pid:xid:nid:opc:job lfs:275b1235-b8f5-4ce3-8a3a-d483c556f740:307806:1869755188167936:192.168.203.144@tcp:36:lfs.0 00000100:00100000:0.0:1783145951.285213:0:307806:0:(client.c:2701:ptlrpc_set_wait()) set ffff920e158e2180 going to sleep for 176 seconds 00000100:00100000:0.0:1783145951.287562:0:307806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff920e4143fb80 pname:cluuid:pid:xid:nid:opc:job lfs:275b1235-b8f5-4ce3-8a3a-d483c556f740:307806:1869755188167936:192.168.203.144@tcp:36:lfs.0 00000080:00200000:0.0:1783145951.287601:0:307806:0:(llite_lib.c:3226:ll_read_inode2()) VFS Op:inode=[0x2000013a1:0x1f2:0x0](ffff920e32621988) 00000080:00200000:0.0:1783145951.287608:0:307806:0:(llite_lib.c:2989:ll_update_inode()) inode=[0x2000013a1:0x1f2:0x0], updating i_size 4096 00000080:00200008:0.0:1783145951.287627:0:307806:0:(file.c:447:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff920e27be80c8), flags 300000 00010000:00010000:2.0:1783145951.290099:0:305427:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783145952.314112:0:289344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783145952.648277:0:307970:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_77s: @@@@@@ FAIL: fail to start 'tbf jobid' policy Debug log: 796 lines, 796 kept, 0 dropped, 0 bad.