00000100:00000400:2.0F:1777502478.479710:0:273093:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777502110/real 1777502110] req@ffffa07571e85180 x1863837563115776/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/1152 e 14 to 1 dl 1777502478 ref 2 fl Rpc:XQr/600/ffffffff rc 0/-1 job:'rm.500' uid:500 gid:500 projid:0 00000100:00080000:2.0:1777502478.489729:0:273093:0:(import.c:65:import_set_state_nolock()) ffffa075454ee000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777502478.489740:0:273093:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffffa07549afe000: Connection to lustre-MDT0000 (at 192.168.202.127@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777502478.494669:0:273093:0:(import.c:416:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1777502478.494756:0:91943:0:(pinger.c:229:ptlrpc_pinger_process_import()) 0775d2ab-558e-41f1-82c0-14244d133390->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777502478.494761:0:91943:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777502478.494765:0:91943:0:(import.c:65:import_set_state_nolock()) ffffa075454ee000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777502478.494775:0:91943:0:(import.c:509:import_select_connection()) lustre-MDT0000-mdc-ffffa07549afe000: connect to NID 192.168.202.127@tcp last attempt 7960 00000100:00080000:2.0:1777502478.494788:0:91943:0:(import.c:623:import_select_connection()) lustre-MDT0000-mdc-ffffa07549afe000: import ffffa075454ee000 using connection 192.168.202.127@tcp/192.168.202.127@tcp 00000008:00100000:2.0:1777502478.494798:0:91943:0:(osc_request.c:3829:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34681949 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1777502478.494817:0:91943:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa07547158700 x1863837567203584/t0(0) o38->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777502478.494872:0:2372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:c3865704-aa9b-444e-8420-b5af90b3c217:2372:1863837567203456:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502478.494968:0:2372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567203840:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502478.495010:0:2372:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777502478.495018:0:2372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567203712:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502478.495060:0:2369:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0775d2ab-558e-41f1-82c0-14244d133390:2369:1863837567203584:192.168.202.127@tcp:38:kworker.0 00000100:00100000:2.0:1777502478.495223:0:273093:0:(client.c:2691:ptlrpc_set_wait()) set ffffa07543c46480 going to sleep for 0 seconds 00000100:00100000:2.0:1777502478.496538:0:2372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547158000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567203712:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502478.496552:0:2372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547159180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:c3865704-aa9b-444e-8420-b5af90b3c217:2372:1863837567203456:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502478.496563:0:2372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547159500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567203840:192.168.202.127@tcp:400:kworker.0 00000100:00100000:0.0F:1777502478.501243:0:2369:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffffa07549afe000: committing for last_committed 8589949328 gen 1 00000100:00080000:0.0:1777502478.501282:0:2369:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffffa07549afe000: connect to target with instance 2 00000100:00080000:0.0:1777502478.501301:0:2369:0:(import.c:1295:ptlrpc_connect_interpret()) reconnected to lustre-MDT0000_UUID@192.168.202.127@tcp after partition 00000100:00080000:0.0:1777502478.501305:0:2369:0:(import.c:65:import_set_state_nolock()) ffffa075454ee000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1777502478.501310:0:2369:0:(import.c:65:import_set_state_nolock()) ffffa075454ee000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777502478.501396:0:2369:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-mdc-ffffa07549afe000: Connection restored to 192.168.202.127@tcp (at 192.168.202.127@tcp) 00000100:00080000:0.0:1777502478.506264:0:2369:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 0000000012de6a07): req@ffffa07571e85180 x1863837563115776/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/1152 e 14 to 1 dl 1777502478 ref 2 fl Rpc:XQU/600/ffffffff rc 0/-1 job:'rm.500' uid:500 gid:500 projid:0 00000100:00100000:0.0:1777502478.506288:0:2369:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547158700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0775d2ab-558e-41f1-82c0-14244d133390:2369:1863837567203584:192.168.202.127@tcp:38:kworker.0 00000100:00080000:0.0:1777502478.506347:0:273093:0:(client.c:3730:ptlrpc_set_mbits()) resend with new mbits old x1863837563115776 new x1863837567203968 00000100:00100000:0.0:1777502478.506428:0:273093:0:(client.c:2691:ptlrpc_set_wait()) set ffffa07543c46480 going to sleep for 363 seconds 00000100:00100000:0.0:1777502478.507952:0:273093:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07571e85180 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273093:1863837563115776:192.168.202.127@tcp:101:rm.500 00010000:00010000:0.0:1777502478.507967:0:273093:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.507977:0:273093:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.507983:0:273093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.507988:0:273093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.507993:0:273093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.507997:0:273093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0756ac87c00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502478.508007:0:273093:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.508013:0:273093:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.508018:0:273093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.508022:0:273093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777502478.508027:0:273093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.508032:0:273093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0756ac87c00/0xac3ccf43bf834602 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502478.508052:0:273093:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07571e85180 x1863837563115776/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 14 to 0 dl 1777502846 ref 1 fl Complete:RQU/602/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:0.0:1777502478.508062:0:273093:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:0.0:1777502478.508118:0:273093:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000080:00200000:3.0F:1777502478.508121:0:273058:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-06, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:3.0:1777502478.508134:0:273058:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-06, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:0.0:1777502478.508135:0:273093:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502478.508150:0:273093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000002:00010000:3.0:1777502478.508153:0:273058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-06,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502478.508168:0:273093:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00000080:00200000:0.0:1777502478.508176:0:273093:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:0.0:1777502478.508183:0:273093:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:0.0:1777502478.508188:0:273093:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00010000:00010000:3.0:1777502478.508204:0:273058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00010000:0.0:1777502478.508211:0:273093:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44aebb58 00010000:00010000:3.0:1777502478.508217:0:273058:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.508217:0:273093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1777502478.508241:0:273058:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.508241:0:273093:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1777502478.508265:0:273093:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000100:00100000:3.0:1777502478.508276:0:273058:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07569c5e680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273058:1863837567204096:192.168.202.127@tcp:101:rm.500 00000100:00100000:0.0:1777502478.508291:0:273093:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0756b65a680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273093:1863837567204224:192.168.202.127@tcp:49:rm.500 00000100:00100000:3.0:1777502478.508333:0:273058:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c172f00 going to sleep for 458 seconds 00000100:00100000:0.0:1777502478.508333:0:273093:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757e8a6900 going to sleep for 458 seconds 00000100:00100000:0.0:1777502478.509315:0:273093:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0756b65a680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273093:1863837567204224:192.168.202.127@tcp:49:rm.500 00000100:00100000:3.0:1777502478.509343:0:273058:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07569c5e680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273058:1863837567204096:192.168.202.127@tcp:101:rm.500 00000080:00200000:0.0:1777502478.509346:0:273093:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=d77r.sanityn, dir=[0x200000007:0x1:0x0](ffffa0756f8b4b08), flags=56 00000080:00200000:0.0:1777502478.509353:0:273093:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=d77r.sanityn, dir=[0x200000007:0x1:0x0](ffffa0756f8b4b08), intent=0 00010000:00010000:3.0:1777502478.509362:0:273058:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00010000:0.0:1777502478.509364:0:273093:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: d77r.sanityn,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1777502478.509377:0:273058:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.509384:0:273058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.509392:0:273058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.509397:0:273093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.509400:0:273058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.509406:0:273093:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.509411:0:273058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075453b2000 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502478.509415:0:273093:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.509423:0:273058:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502478.509427:0:273093:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0756b65a680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273093:1863837567204352:192.168.202.127@tcp:101:rm.500 00010000:00010000:3.0:1777502478.509436:0:273058:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.509443:0:273058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.509450:0:273058:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.509454:0:273058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502478.509458:0:273093:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757e8a6900 going to sleep for 458 seconds 00010000:00010000:3.0:1777502478.509464:0:273058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf845622 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273058 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1777502478.509485:0:273058:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07569c5e680 x1863837567204096/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:3.0:1777502478.509496:0:273058:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.509536:0:273058:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.509545:0:273058:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.509553:0:273058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:0.0:1777502478.509554:0:273075:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-10, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:0.0:1777502478.509563:0:273075:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-10, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00010000:00010000:3.0:1777502478.509568:0:273058:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00000080:00200000:3.0:1777502478.509575:0:273058:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000002:00010000:0.0:1777502478.509575:0:273075:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-10,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00000080:00010000:3.0:1777502478.509581:0:273058:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.509587:0:273058:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.509599:0:273058:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44a5bc10 00010000:00010000:3.0:1777502478.509603:0:273058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1777502478.509612:0:273058:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502478.509614:0:273075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.509670:0:273075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.509676:0:273075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777502478.509687:0:273075:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0756b658700 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273075:1863837567204480:192.168.202.127@tcp:101:rm.500 00000100:00100000:0.0:1777502478.509710:0:273075:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757e8a6d80 going to sleep for 458 seconds 00000080:00200000:3.0:1777502478.509911:0:273058:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000100:00100000:0.0:1777502478.511032:0:273075:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0756b658700 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273075:1863837567204480:192.168.202.127@tcp:101:rm.500 00010000:00010000:0.0:1777502478.511041:0:273075:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511048:0:273075:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511053:0:273075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511057:0:273075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511061:0:273075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511065:0:273075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757a2d6c00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502478.511067:0:273075:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511079:0:273075:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511083:0:273075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511086:0:273075:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777502478.511089:0:273075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511092:0:273075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d6c00/0xac3ccf43bf845630 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273075 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502478.511105:0:273075:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa0756b658700 x1863837567204480/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:0.0:1777502478.511113:0:273075:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:0.0:1777502478.511138:0:273075:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:0.0:1777502478.511148:0:273075:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502478.511157:0:273075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502478.511166:0:273075:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00000080:00200000:0.0:1777502478.511173:0:273075:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:0.0:1777502478.511178:0:273075:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:0.0:1777502478.511181:0:273075:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:0.0:1777502478.511185:0:273075:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44a9bc10 00010000:00010000:0.0:1777502478.511195:0:273075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0 00010000:00010000:0.0:1777502478.511203:0:273075:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:0.0:1777502478.511213:0:273075:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.511219:0:273064:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-08, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:3.0:1777502478.511225:0:273064:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-08, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:3.0:1777502478.511236:0:273064:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-08,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.511309:0:273064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.511318:0:273064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.511327:0:273064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502478.511342:0:273064:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07569c5e680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273064:1863837567204608:192.168.202.127@tcp:101:rm.500 00000100:00100000:3.0:1777502478.511384:0:273064:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c172f00 going to sleep for 458 seconds 00000100:00100000:0.0:1777502478.511454:0:273093:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0756b65a680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273093:1863837567204352:192.168.202.127@tcp:101:rm.500 00010000:00010000:0.0:1777502478.511461:0:273093:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511466:0:273093:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511473:0:273093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511478:0:273093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511484:0:273093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511490:0:273093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757a2d7600 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502478.511492:0:273093:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511498:0:273093:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511505:0:273093:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511516:0:273093:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777502478.511520:0:273093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.511525:0:273093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757a2d7600/0xac3ccf43bf845629 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 273093 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502478.511533:0:273093:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=10 disposition=7, status=0 req@ffffa0756b65a680 x1863837567204352/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:0.0:1777502478.511543:0:273093:0:(namei.c:950:ll_intent_lock()) intent lock 16 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 0 00010000:00010000:0.0:1777502478.511564:0:273093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00010000:00010000:0.0:1777502478.511573:0:273093:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00010000:0.0:1777502478.511580:0:273093:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44aeb8d0 00010000:00010000:0.0:1777502478.511583:0:273093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0 00000080:00200000:3.0:1777502478.511586:0:273075:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00010000:00010000:0.0:1777502478.511593:0:273093:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1777502478.511678:0:273093:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:0.0:1777502478.511684:0:273093:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1777502478.511690:0:273093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1777502478.511710:0:273093:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00000080:00200000:0.0:1777502478.511717:0:273093:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:0.0:1777502478.511722:0:273093:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:0.0:1777502478.511725:0:273093:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:0.0:1777502478.511729:0:273093:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44aebc10 00010000:00010000:0.0:1777502478.511733:0:273093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 5 lru_type: 0 00010000:00010000:0.0:1777502478.511741:0:273093:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:0.0:1777502478.511752:0:273093:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:0.0:1777502478.511757:0:273093:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=24 00000100:00100000:3.0:1777502478.514328:0:273064:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07569c5e680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273064:1863837567204608:192.168.202.127@tcp:101:rm.500 00010000:00010000:3.0:1777502478.514349:0:273064:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514361:0:273064:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514380:0:273064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514387:0:273064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514394:0:273064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514401:0:273064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075453b3e00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:3.0:1777502478.514405:0:273064:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514411:0:273064:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514419:0:273064:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514426:0:273064:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.514432:0:273064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.514438:0:273064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b3e00/0xac3ccf43bf845637 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273064 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1777502478.514465:0:273064:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07569c5e680 x1863837567204608/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:3.0:1777502478.514477:0:273064:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.514528:0:273064:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.514548:0:273064:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.514559:0:273064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1777502478.514569:0:273064:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00000080:00200000:3.0:1777502478.514576:0:273064:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.514581:0:273064:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.514584:0:273064:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.514589:0:273064:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44b23c10 00010000:00010000:3.0:1777502478.514595:0:273064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 6 lru_type: 0 00010000:00010000:3.0:1777502478.514611:0:273064:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:3.0:1777502478.514653:0:273064:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.514660:0:273064:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:3.0:1777502478.515531:0:273102:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=8 00000080:00200000:3.0:1777502478.515536:0:273102:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-19, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:3.0:1777502478.515551:0:273102:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-19,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.515595:0:273102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.515604:0:273102:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.515614:0:273102:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502478.515667:0:273102:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07569c5e680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273102:1863837567204736:192.168.202.127@tcp:101:rm.500 00000100:00100000:3.0:1777502478.515733:0:273102:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c172f00 going to sleep for 458 seconds 00000080:00200000:3.0:1777502478.515755:0:273103:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=8 00000080:00200000:3.0:1777502478.515759:0:273103:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-20, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:3.0:1777502478.515770:0:273103:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-20,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.515790:0:273103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.515798:0:273103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.515806:0:273103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502478.515819:0:273103:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07569c5f480 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273103:1863837567204864:192.168.202.127@tcp:101:rm.500 00000100:00100000:3.0:1777502478.515845:0:273103:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c172180 going to sleep for 458 seconds 00000080:00200000:3.0:1777502478.515990:0:273058:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:1.0F:1777502478.516216:0:273094:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-16, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=8 00000080:00200000:1.0:1777502478.516227:0:273094:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-16, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:1.0:1777502478.516237:0:273094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-16,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:1.0:1777502478.516264:0:273094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x10000000000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777502478.516273:0:273094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777502478.516281:0:273094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x0 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777502478.516295:0:273094:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0756b728380 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273094:1863837567204992:192.168.202.127@tcp:101:rm.500 00000100:00100000:1.0:1777502478.516330:0:273094:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757a274cc0 going to sleep for 458 seconds 00000080:00200000:1.0:1777502478.516345:0:273095:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=8 00000080:00200000:1.0:1777502478.516348:0:273095:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-17, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:1.0:1777502478.516356:0:273095:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-17,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:1.0:1777502478.516373:0:273095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x10000000000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777502478.516378:0:273095:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777502478.516382:0:273095:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777502478.516391:0:273095:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0756b728a80 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273095:1863837567205120:192.168.202.127@tcp:101:rm.500 00000100:00100000:1.0:1777502478.516417:0:273095:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757a2743c0 going to sleep for 458 seconds 00000100:00100000:0.0:1777502478.518715:0:273102:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07569c5e680 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273102:1863837567204736:192.168.202.127@tcp:101:rm.500 00010000:00010000:0.0:1777502478.518733:0:273102:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x0 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518745:0:273102:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x206400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518752:0:273102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x10206400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502478.518760:0:273103:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07569c5f480 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273103:1863837567204864:192.168.202.127@tcp:101:rm.500 00010000:00010000:0.0:1777502478.518761:0:273102:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x10206400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518775:0:273103:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x0 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518795:0:273103:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x206400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518796:0:273102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x206400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518811:0:273103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x10206400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518819:0:273103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x10206400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518833:0:273103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x206400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518833:0:273102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075453b2000 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:0.0:1777502478.518840:0:273102:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x206400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518842:0:273103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075453b2c00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:3.0:1777502478.518849:0:273103:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x206400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518851:0:273102:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x206400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518860:0:273103:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x206400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518864:0:273102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x20e400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518871:0:273103:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x20e400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518874:0:273102:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777502478.518893:0:273102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518894:0:273103:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.518900:0:273103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777502478.518903:0:273102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2000/0xac3ccf43bf84563e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 273102 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.518917:0:273103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf845645 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 6 type: IBT flags: 0x4a0f400000000 pid: 273103 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:0.0:1777502478.518929:0:273102:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07569c5e680 x1863837567204736/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000002:00100000:3.0:1777502478.518933:0:273103:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07569c5f480 x1863837567204864/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:0.0:1777502478.518954:0:273102:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.518955:0:273103:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.519014:0:273103:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000080:00200000:0.0:1777502478.519014:0:273102:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.519032:0:273103:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000002:00010000:0.0:1777502478.519032:0:273102:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.519050:0:273103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:3.0:1777502478.519063:0:273103:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:0.0:1777502478.519063:0:273102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00010000:00010000:0.0:1777502478.519076:0:273102:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:3.0:1777502478.519080:0:273103:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.519086:0:273103:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.519092:0:273103:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00200000:0.0:1777502478.519094:0:273102:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.519098:0:273103:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44b93b58 00000080:00010000:0.0:1777502478.519101:0:273102:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00010000:00010000:3.0:1777502478.519103:0:273103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 4/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00010000:0.0:1777502478.519105:0:273102:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00010000:00010000:3.0:1777502478.519116:0:273103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:3.0:1777502478.519125:0:273103:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00010000:0.0:1777502478.519125:0:273102:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44ac3b58 00010000:00010000:0.0:1777502478.519130:0:273102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 7 lru_type: 0 00000080:00200000:3.0:1777502478.519135:0:273103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00010000:00010000:0.0:1777502478.519142:0:273102:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00200000:0.0:1777502478.519156:0:273102:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:0.0:1777502478.519162:0:273102:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:3.0:1777502478.519164:0:273103:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.519172:0:273103:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.519179:0:273103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00200000:0.0:1777502478.519188:0:273102:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00010000:00010000:3.0:1777502478.519189:0:273103:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000002:00010000:0.0:1777502478.519197:0:273102:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000080:00200000:3.0:1777502478.519198:0:273103:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.519207:0:273103:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.519210:0:273103:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00010000:00010000:0.0:1777502478.519210:0:273102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1777502478.519224:0:273102:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 4/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00010000:3.0:1777502478.519226:0:273103:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44b93c10 00010000:00010000:3.0:1777502478.519232:0:273103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 4/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00200000:0.0:1777502478.519236:0:273102:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:0.0:1777502478.519245:0:273102:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:0.0:1777502478.519249:0:273102:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00010000:00010000:3.0:1777502478.519260:0:273103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00200000:3.0:1777502478.519268:0:273103:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00010000:0.0:1777502478.519268:0:273102:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44ac3c10 00010000:00010000:0.0:1777502478.519274:0:273102:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 8 lru_type: 1 00000080:00200000:3.0:1777502478.519275:0:273103:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=24 00010000:00010000:0.0:1777502478.519297:0:273102:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:0.0:1777502478.519308:0:273102:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:0.0:1777502478.519313:0:273102:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=24 00000100:00100000:2.0:1777502478.522111:0:273095:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0756b728a80 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273095:1863837567205120:192.168.202.127@tcp:101:rm.500 00010000:00010000:2.0:1777502478.522129:0:273095:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522141:0:273095:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522149:0:273095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522156:0:273095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522164:0:273095:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522170:0:273095:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757538f400 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:2.0:1777502478.522174:0:273095:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522181:0:273095:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x206400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522188:0:273095:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x20e400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522196:0:273095:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777502478.522202:0:273095:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.522209:0:273095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538f400/0xac3ccf43bf845653 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 273095 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1777502478.522234:0:273095:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa0756b728a80 x1863837567205120/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:2.0:1777502478.522247:0:273095:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:2.0:1777502478.522288:0:273095:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:2.0:1777502478.522302:0:273095:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1777502478.522314:0:273095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1777502478.522326:0:273095:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00000080:00200000:2.0:1777502478.522333:0:273095:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:2.0:1777502478.522339:0:273095:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:2.0:1777502478.522342:0:273095:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:2.0:1777502478.522348:0:273095:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44a23b58 00010000:00010000:2.0:1777502478.522351:0:273095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1777502478.522360:0:273095:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:2.0:1777502478.522374:0:273095:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:2.0:1777502478.522381:0:273095:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:2.0:1777502478.522404:0:273095:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:2.0:1777502478.522411:0:273095:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1777502478.522418:0:273095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1777502478.522434:0:273095:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00000080:00200000:2.0:1777502478.522441:0:273095:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:2.0:1777502478.522445:0:273095:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:2.0:1777502478.522448:0:273095:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:2.0:1777502478.522452:0:273095:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44a23c10 00010000:00010000:2.0:1777502478.522454:0:273095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1777502478.522461:0:273095:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:2.0:1777502478.522470:0:273095:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:2.0:1777502478.522474:0:273095:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=24 00000100:00100000:3.0:1777502478.523385:0:273094:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0756b728380 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273094:1863837567204992:192.168.202.127@tcp:101:rm.500 00010000:00010000:3.0:1777502478.523399:0:273094:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523409:0:273094:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523417:0:273094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523424:0:273094:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523432:0:273094:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523439:0:273094:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0757538e600 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:3.0:1777502478.523442:0:273094:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523450:0:273094:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523457:0:273094:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523472:0:273094:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.523477:0:273094:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.523484:0:273094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa0757538e600/0xac3ccf43bf84564c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273094 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1777502478.523506:0:273094:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa0756b728380 x1863837567204992/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:3.0:1777502478.523517:0:273094:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.523557:0:273094:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.523566:0:273094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.523574:0:273094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1777502478.523584:0:273094:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00000080:00200000:3.0:1777502478.523591:0:273094:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.523596:0:273094:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.523599:0:273094:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.523604:0:273094:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f448bbb58 00010000:00010000:3.0:1777502478.523608:0:273094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 11 lru_type: 1 00010000:00010000:3.0:1777502478.523617:0:273094:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:3.0:1777502478.523965:0:273094:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.523970:0:273094:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:3.0:1777502478.523995:0:273094:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.524003:0:273094:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.524012:0:273094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:3.0:1777502478.524021:0:273094:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00000080:00200000:3.0:1777502478.524028:0:273094:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.524033:0:273094:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.524035:0:273094:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.524040:0:273094:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f448bbc10 00010000:00010000:3.0:1777502478.524043:0:273094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 12 lru_type: 1 00010000:00010000:3.0:1777502478.524052:0:273094:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:3.0:1777502478.524062:0:273094:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.524067:0:273094:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=24 00000080:00200000:2.0:1777502478.524120:0:273083:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-11, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:2.0:1777502478.524124:0:273083:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-11, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:2.0:1777502478.524135:0:273083:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-11,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:2.0:1777502478.524169:0:273083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.524175:0:273083:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.524182:0:273083:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502478.524197:0:273083:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547159500 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273083:1863837567205248:192.168.202.127@tcp:101:rm.500 00000100:00100000:2.0:1777502478.524257:0:273083:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c809b40 going to sleep for 458 seconds 00000100:00100000:3.0:1777502478.526498:0:273083:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547159500 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273083:1863837567205248:192.168.202.127@tcp:101:rm.500 00010000:00010000:3.0:1777502478.526516:0:273083:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526528:0:273083:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526542:0:273083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526548:0:273083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526556:0:273083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526562:0:273083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07552590200 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:3.0:1777502478.526568:0:273083:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526574:0:273083:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526581:0:273083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526587:0:273083:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.526593:0:273083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526599:0:273083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590200/0xac3ccf43bf84565a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273083 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1777502478.526621:0:273083:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07547159500 x1863837567205248/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:3.0:1777502478.526656:0:273083:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.526705:0:273083:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000080:00200000:2.0:1777502478.526711:0:273086:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:2.0:1777502478.526718:0:273086:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-18, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:3.0:1777502478.526724:0:273083:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00000002:00010000:2.0:1777502478.526731:0:273086:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-18,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.526736:0:273083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:3.0:1777502478.526748:0:273083:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00000080:00200000:3.0:1777502478.526756:0:273083:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.526762:0:273083:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.526766:0:273083:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.526770:0:273083:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44943c10 00010000:00010000:2.0:1777502478.526774:0:273086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526775:0:273083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 13 lru_type: 1 00010000:00010000:2.0:1777502478.526795:0:273086:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.526797:0:273083:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:2.0:1777502478.526812:0:273086:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00000080:00200000:3.0:1777502478.526817:0:273083:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.526826:0:273083:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000100:00100000:2.0:1777502478.526834:0:273086:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547159180 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273086:1863837567205376:192.168.202.127@tcp:101:rm.500 00000100:00100000:2.0:1777502478.526900:0:273086:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c8099c0 going to sleep for 458 seconds 00000100:00100000:3.0:1777502478.529169:0:273086:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547159180 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273086:1863837567205376:192.168.202.127@tcp:101:rm.500 00010000:00010000:3.0:1777502478.529190:0:273086:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529202:0:273086:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529209:0:273086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529232:0:273086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529240:0:273086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529247:0:273086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07552590e00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:3.0:1777502478.529251:0:273086:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529259:0:273086:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529267:0:273086:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529275:0:273086:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.529281:0:273086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.529288:0:273086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552590e00/0xac3ccf43bf845661 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273086 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1777502478.529317:0:273086:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07547159180 x1863837567205376/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:3.0:1777502478.529332:0:273086:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.529382:0:273086:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.529394:0:273086:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.529406:0:273086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:3.0:1777502478.529424:0:273086:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00000080:00200000:3.0:1777502478.529432:0:273086:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.529439:0:273086:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.529442:0:273086:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.529447:0:273086:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44b1bc10 00010000:00010000:3.0:1777502478.529451:0:273086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 14 lru_type: 1 00010000:00010000:3.0:1777502478.529460:0:273086:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:3.0:1777502478.529475:0:273086:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.529482:0:273086:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:2.0:1777502478.529601:0:273092:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-14, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:2.0:1777502478.529607:0:273092:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-14, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:2.0:1777502478.529621:0:273092:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-14,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:2.0:1777502478.529686:0:273092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.529695:0:273092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.529705:0:273092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502478.529725:0:273092:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547158000 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273092:1863837567205504:192.168.202.127@tcp:101:rm.500 00000100:00100000:2.0:1777502478.529783:0:273092:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c809780 going to sleep for 458 seconds 00000100:00100000:3.0:1777502478.531533:0:273092:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547158000 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273092:1863837567205504:192.168.202.127@tcp:101:rm.500 00010000:00010000:3.0:1777502478.531548:0:273092:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531560:0:273092:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531566:0:273092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531573:0:273092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531591:0:273092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531598:0:273092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07552591800 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:3.0:1777502478.531602:0:273092:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531609:0:273092:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531616:0:273092:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531645:0:273092:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.531650:0:273092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.531657:0:273092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591800/0xac3ccf43bf845668 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273092 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1777502478.531681:0:273092:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07547158000 x1863837567205504/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:3.0:1777502478.531692:0:273092:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.531728:0:273092:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.531740:0:273092:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.531749:0:273092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:3.0:1777502478.531759:0:273092:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00000080:00200000:3.0:1777502478.531773:0:273092:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.531779:0:273092:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.531782:0:273092:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.531788:0:273092:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44a1bc10 00010000:00010000:3.0:1777502478.531791:0:273092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 15 lru_type: 1 00010000:00010000:3.0:1777502478.531799:0:273092:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:3.0:1777502478.531811:0:273092:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.531817:0:273092:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:3.0:1777502478.532578:0:273091:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-12, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:3.0:1777502478.532584:0:273091:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-12, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:3.0:1777502478.532598:0:273091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-12,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.534278:0:273091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.534289:0:273091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.534301:0:273091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777502478.534328:0:273091:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07569c5f480 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273091:1863837567205632:192.168.202.127@tcp:101:rm.500 00000100:00100000:3.0:1777502478.534709:0:273091:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c172180 going to sleep for 458 seconds 00000100:00100000:3.0:1777502478.538909:0:273091:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07569c5f480 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273091:1863837567205632:192.168.202.127@tcp:101:rm.500 00010000:00010000:3.0:1777502478.538937:0:273091:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.538951:0:273091:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.538959:0:273091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.538966:0:273091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.538974:0:273091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.538980:0:273091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa075453b2c00 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:3.0:1777502478.538984:0:273091:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.538991:0:273091:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.538998:0:273091:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.539006:0:273091:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777502478.539013:0:273091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777502478.539018:0:273091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa075453b2c00/0xac3ccf43bf84566f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273091 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:3.0:1777502478.539052:0:273091:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07569c5f480 x1863837567205632/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:3.0:1777502478.539067:0:273091:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:3.0:1777502478.539124:0:273091:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:3.0:1777502478.539139:0:273091:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1777502478.539151:0:273091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:3.0:1777502478.539163:0:273091:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00000080:00200000:3.0:1777502478.539170:0:273091:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:3.0:1777502478.539176:0:273091:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:3.0:1777502478.539180:0:273091:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:3.0:1777502478.539185:0:273091:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f44b6bc10 00010000:00010000:3.0:1777502478.539189:0:273091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 16 lru_type: 1 00010000:00010000:3.0:1777502478.539197:0:273091:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:3.0:1777502478.539211:0:273091:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:3.0:1777502478.539218:0:273091:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00000080:00200000:2.0:1777502478.540974:0:273082:0:(namei.c:1329:ll_lookup_nd()) VFS Op:name=f77r.sanityn-13, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), flags=0 00000080:00200000:2.0:1777502478.540982:0:273082:0:(namei.c:1070:ll_lookup_it()) VFS Op:name=f77r.sanityn-13, dir=[0x200000bd1:0x20:0x0](ffffa0756f8b6c08), intent=getattr 00000002:00010000:2.0:1777502478.541000:0:273082:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: f77r.sanityn-13,[0x0:0x0:0x0]) in obj [0x200000bd1:0x20:0x0], intent: getattr flags 0 00010000:00010000:2.0:1777502478.541049:0:273082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.541060:0:273082:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.541070:0:273082:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777502478.541098:0:273082:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547158380 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273082:1863837567205760:192.168.202.127@tcp:101:rm.500 00000100:00100000:2.0:1777502478.541172:0:273082:0:(client.c:2691:ptlrpc_set_wait()) set ffffa0757c809f00 going to sleep for 458 seconds 00000100:00100000:2.0:1777502478.544556:0:273082:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547158380 pname:cluuid:pid:xid:nid:opc:job rm:0775d2ab-558e-41f1-82c0-14244d133390:273082:1863837567205760:192.168.202.127@tcp:101:rm.500 00010000:00010000:2.0:1777502478.544574:0:273082:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544585:0:273082:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544590:0:273082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 4/1,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544596:0:273082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544602:0:273082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544618:0:273082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa07552591400 already unused, calling callback (ffffffffc1caf310) 00010000:00010000:2.0:1777502478.544647:0:273082:0:(ldlm_request.c:1724:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544654:0:273082:0:(ldlm_request.c:1734:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544661:0:273082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 5/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544669:0:273082:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777502478.544676:0:273082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777502478.544683:0:273082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591400/0xac3ccf43bf845676 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x20:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 273082 initiator: MDT0 lru_score: 0 lru_type: 0 00000002:00100000:2.0:1777502478.544709:0:273082:0:(mdc_locks.c:833:mdc_finish_enqueue()) @@@ op=8 disposition=3, status=-116 req@ffffa07547158380 x1863837567205760/t0(0) o101->lustre-MDT0000-mdc-ffffa07549afe000@192.168.202.127@tcp:12/10 lens 584/584 e 0 to 0 dl 1777502941 ref 1 fl Complete:RQU/600/0 rc 301/301 job:'rm.500' uid:500 gid:500 projid:0 00000080:00200000:2.0:1777502478.544722:0:273082:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000bd1:0x20:0x0] suppgids -1 -1: rc -116 00000080:00200000:2.0:1777502478.544765:0:273082:0:(file.c:6122:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08),name=/ 00000002:00010000:2.0:1777502478.544780:0:273082:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1777502478.544794:0:273082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:2.0:1777502478.544805:0:273082:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00000080:00200000:2.0:1777502478.544814:0:273082:0:(namei.c:950:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids -1 -1: rc 1 00000080:00010000:2.0:1777502478.544826:0:273082:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) 00000080:00010000:2.0:1777502478.544830:0:273082:0:(llite_internal.h:1985:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffffa0756f8b4b08) for lock 0xac3ccf43bf84561b 00000080:00010000:2.0:1777502478.544836:0:273082:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xac3ccf43bf84561b from it ffffbd7f4499bc10 00010000:00010000:2.0:1777502478.544839:0:273082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 17 lru_type: 1 00010000:00010000:2.0:1777502478.544849:0:273082:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffffa07549afe000 lock: ffffa07552591200/0xac3ccf43bf84561b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4ad31463d9c2e507 expref: -99 pid: 299245 timeout: 0 lvb_type: 0 lru_score: 18 lru_type: 1 00000080:00200000:2.0:1777502478.544863:0:273082:0:(file.c:6594:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffffa0756f8b4b08), inode mode 41ff mask 1 00000080:00200000:2.0:1777502478.544871:0:273082:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=d77r.sanityn, flags=56 00010000:00010000:2.0:1777502478.864720:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777502479.887784:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777502480.911726:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777502481.936273:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777502482.374414:0:301102:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 114: implicit default LMV inherit ======== 18:41:21 (1777502481) 00010000:00010000:0.0:1777502482.959813:0:259773:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777502483.025642:0:301239:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_114 We need at least 2 MDTs for this test 00000100:00100000:3.0:1777502483.599818:0:2373:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa07547158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:c3865704-aa9b-444e-8420-b5af90b3c217:2373:1863837567205888:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502483.599848:0:2372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0754715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567206016:192.168.202.127@tcp:400:kworker.0 00000100:00100000:3.0:1777502483.599976:0:2373:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0754715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0775d2ab-558e-41f1-82c0-14244d133390:2373:1863837567206144:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502483.599977:0:2372:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffffa0754715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567206272:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502483.601862:0:2373:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa07547158380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:c3865704-aa9b-444e-8420-b5af90b3c217:2373:1863837567205888:192.168.202.127@tcp:400:kworker.0 00000100:00100000:2.0:1777502483.601886:0:2373:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0754715b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:0775d2ab-558e-41f1-82c0-14244d133390:2373:1863837567206144:192.168.202.127@tcp:400:kworker.0 00000100:00100000:3.0:1777502483.601892:0:2372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0754715aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567206016:192.168.202.127@tcp:400:kworker.0 00000100:00100000:3.0:1777502483.601909:0:2372:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffffa0754715bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:0775d2ab-558e-41f1-82c0-14244d133390:2372:1863837567206272:192.168.202.127@tcp:400:kworker.0 00000001:02000400:3.0:1777502483.679286:0:301391:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 18:41:23 (1777502483) 00010000:00010000:2.0:1777502483.983860:0:259263:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777502484.289293:0:301527:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_115 ldiskfs only test 00000001:02000400:1.0:1777502484.912878:0:301679:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 18:41:24 (1777502484) 00010000:00010000:3.0:1777502485.007741:0:270435:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777502485.486234:0:301815:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanityn test_116 needs >= 2 MDTs 00010000:00010000:2.0:1777502486.031772:0:259262:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777502486.096970:0:301967:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 121: trunc append race =================== 18:41:25 (1777502485) 00000001:02000400:2.0:1777502486.643319:0:302105:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_121: @@@@@@ FAIL: setstripe /mnt/lustre/f121.sanityn failed 00010000:00010000:3.0:1777502487.055838:0:263969:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 592 lines, 592 kept, 0 dropped, 0 bad.