00010000:00010000:0.0F:1781307301.227456:0:147842:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307302.251647:0:144655:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307303.267925:0:130015:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1781307304.293319:0:147841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:0.0:1781307304.993939:0:227162:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:0.0:1781307304.993945:0:227162:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity test_817 skipping ALWAYS excluded test 817 00000100:00080000:1.0F:1781307305.315533:0:197546:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1781307305.315547:0:197546:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1781307305.315584:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b0c6c7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456906432:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1781307305.315682:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9b215ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456906560:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1781307305.315714:0:2273:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1781307305.315720:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa551f45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456906496:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1781307305.315743:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f9571bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456906624:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00010000:0.0:1781307305.319384:0:147065:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781307305.328262:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b0c6c7e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456906432:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00080000:1.0:1781307305.328287:0:2273:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000d9b215ed x1867826456906560/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307336 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:1.0:1781307305.328299:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9b215ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456906560:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1781307305.328715:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa551f45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456906496:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:1.0:1781307305.341019:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f9571bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456906624:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00010000:3.0F:1781307306.339565:0:130016:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1781307307.293355:0:227314:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1781307307.293570:0:227314:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity test 818: unlink with failed llog ============== 19:35:05 (1781307305) 00010000:00010000:3.0:1781307307.364754:0:147064:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1781307307.461269:0:227320:0:(llite_lib.c:2585:ll_statfs()) VFS Op:sb=lustre (00000000f3747a49) 00000080:00000004:0.0:1781307307.461283:0:227320:0:(obd_class.h:1069:obd_statfs()) lustre-clilmv-ffff959d07a83000: age 8741, max_age 9292 00800000:00000004:0.0:1781307307.461300:0:227320:0:(obd_class.h:1069:obd_statfs()) lustre-MDT0000-mdc-ffff959d07a83000: age 8741, max_age 9292 00000100:00100000:0.0:1781307307.461391:0:227320:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd2e94c8 pname:cluuid:pid:xid:nid:opc:job stat:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227320:1867826456906688:192.168.206.155@tcp:41:stat.0 00000100:00100000:0.0:1781307307.461511:0:227320:0:(client.c:2500:ptlrpc_set_wait()) set 000000006b0075d5 going to sleep for 30 seconds 00000100:00100000:1.0:1781307307.469315:0:227320:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd2e94c8 pname:cluuid:pid:xid:nid:opc:job stat:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227320:1867826456906688:192.168.206.155@tcp:41:stat.0 00800000:00000004:1.0:1781307307.469357:0:227320:0:(obd_class.h:1093:obd_statfs()) lustre-MDT0000-mdc-ffff959d07a83000: update 00000000c2ef4762 cache blocks 898246/958279 objects 258965/269773 00000080:00000004:1.0:1781307307.469565:0:227320:0:(obd_class.h:1093:obd_statfs()) lustre-clilmv-ffff959d07a83000: update 000000008a4a3d44 cache blocks 898246/958279 objects 258965/269773 00000080:00000004:1.0:1781307307.469571:0:227320:0:(llite_lib.c:2494:ll_statfs_internal()) MDC blocks 898246/958279 objects 258965/269773 00000080:00200000:2.0:1781307307.600234:0:227328:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:2.0:1781307307.600276:0:227328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1781307307.600298:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307307.600315:0:227328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1781307307.600327:0:227328:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:2.0:1781307307.600331:0:227328:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ff5c0 00000080:00010000:2.0:1781307307.600339:0:227328:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ff5c0 from it 000000000e313e51 00010000:00010000:2.0:1781307307.600342:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307307.600351:0:227328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1781307307.600395:0:227328:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:2.0:1781307307.600413:0:227328:0:(namei.c:1111:ll_lookup_nd()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), flags=13 00000080:00200000:2.0:1781307307.600418:0:227328:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), intent=getattr 00000002:00010000:2.0:1781307307.600432:0:227328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d818.sanity,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1781307307.600503:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307307.600511:0:227328:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307307.600523:0:227328:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781307307.600569:0:227328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3c97d5a pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456906752:192.168.206.155@tcp:101:lfs.0 00000100:00100000:2.0:1781307307.600674:0:227328:0:(client.c:2500:ptlrpc_set_wait()) set 00000000527a2de3 going to sleep for 30 seconds 00000100:00100000:0.0:1781307307.613733:0:227328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3c97d5a pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456906752:192.168.206.155@tcp:101:lfs.0 00010000:00010000:0.0:1781307307.613761:0:227328:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613778:0:227328:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613784:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613790:0:227328:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613797:0:227328:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613803:0:227328:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5089ba8 already unused, calling callback (00000000430e9631) 00010000:00010000:0.0:1781307307.613807:0:227328:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613834:0:227328:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613841:0:227328:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613848:0:227328:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1781307307.613854:0:227328:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.613860:0:227328:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000e5089ba8/0x18761f4d8c4ffa20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307307.613876:0:227328:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@00000000d3c97d5a x1867826456906752/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/640 e 0 to 0 dl 1781307338 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:0.0:1781307307.613907:0:227328:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1781307307.613976:0:227328:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:0.0:1781307307.613992:0:227328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1781307307.613998:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.614007:0:227328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1781307307.614014:0:227328:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:0.0:1781307307.614017:0:227328:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ff5c0 00000080:00010000:0.0:1781307307.614034:0:227328:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ff5c0 from it 000000006c12d3de 00010000:00010000:0.0:1781307307.614037:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.614049:0:227328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307307.614061:0:227328:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:0.0:1781307307.614083:0:227328:0:(namei.c:1111:ll_lookup_nd()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), flags=16392 00000080:00200000:0.0:1781307307.614087:0:227328:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), intent=getattr 00000002:00010000:0.0:1781307307.614099:0:227328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d818.sanity,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1781307307.614140:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.614147:0:227328:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.614155:0:227328:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307307.614176:0:227328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000149af22 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456906816:192.168.206.155@tcp:101:lfs.0 00000100:00100000:0.0:1781307307.614277:0:227328:0:(client.c:2500:ptlrpc_set_wait()) set 000000009c28eb90 going to sleep for 30 seconds 00000100:00100000:1.0:1781307307.620617:0:227328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000149af22 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456906816:192.168.206.155@tcp:101:lfs.0 00010000:00010000:1.0:1781307307.620662:0:227328:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620677:0:227328:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620684:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620690:0:227328:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620697:0:227328:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620703:0:227328:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c6869fd8 already unused, calling callback (00000000430e9631) 00010000:00010000:1.0:1781307307.620709:0:227328:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620715:0:227328:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620723:0:227328:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620729:0:227328:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1781307307.620735:0:227328:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620742:0:227328:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c6869fd8/0x18761f4d8c4ffa27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1781307307.620769:0:227328:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@000000000149af22 x1867826456906816/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/640 e 0 to 0 dl 1781307338 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:1.0:1781307307.620806:0:227328:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:1.0:1781307307.620895:0:227328:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:1.0:1781307307.620911:0:227328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1781307307.620917:0:227328:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:1.0:1781307307.620961:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620968:0:227328:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.620978:0:227328:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781307307.620999:0:227328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f9571bd pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456906880:192.168.206.155@tcp:101:lfs.0 00000100:00100000:1.0:1781307307.621080:0:227328:0:(client.c:2500:ptlrpc_set_wait()) set 0000000052f01574 going to sleep for 30 seconds 00000100:00100000:1.0:1781307307.631745:0:227328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f9571bd pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456906880:192.168.206.155@tcp:101:lfs.0 00010000:00010000:1.0:1781307307.631775:0:227328:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631790:0:227328:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631802:0:227328:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631832:0:227328:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631845:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631854:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631860:0:227328:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1781307307.631870:0:227328:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@000000004f9571bd x1867826456906880/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/688 e 0 to 0 dl 1781307338 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1781307307.631882:0:227328:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631894:0:227328:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1781307307.631926:0:227328:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 20480 00000080:00010000:1.0:1781307307.631934:0:227328:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ffa2e 00000080:00010000:1.0:1781307307.631941:0:227328:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:1.0:1781307307.631944:0:227328:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa2e from it 00000000855db20c 00010000:00010000:1.0:1781307307.631945:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.631953:0:227328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307307.632897:0:227328:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:1.0:1781307307.632916:0:227328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1781307307.632926:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.632935:0:227328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1781307307.632943:0:227328:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:1.0:1781307307.632945:0:227328:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ffa2e 00000080:00010000:1.0:1781307307.632949:0:227328:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa2e from it 00000000855db20c 00010000:00010000:1.0:1781307307.632950:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.632958:0:227328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307307.633041:0:227328:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:1.0:1781307307.633048:0:227328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1781307307.633053:0:227328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.633060:0:227328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1781307307.633066:0:227328:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:1.0:1781307307.633068:0:227328:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ff5c0 00000080:00010000:1.0:1781307307.633071:0:227328:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ff5c0 from it 000000008e8bc036 00010000:00010000:1.0:1781307307.633078:0:227328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.633084:0:227328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307307.633091:0:227328:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 44 00000080:00200000:1.0:1781307307.633096:0:227328:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), flags 300000 00000080:00200000:1.0:1781307307.633110:0:227328:0:(dir.c:1427:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), cmd=0xc03066f0 00000080:00200000:1.0:1781307307.633119:0:227328:0:(dir.c:475:ll_dir_setdirstripe()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4) name d818.sanity stripe_offset 0, stripe_count: 1 00010000:00010000:1.0:1781307307.633142:0:227328:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.634441:0:227328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.634584:0:227328:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.634592:0:227328:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1781307307.634594:0:227328:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e5350 expref: -99 pid: 227328 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1781307307.634609:0:227328:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1781307307.634618:0:227328:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004f9571bd x1867826456907008/t0(0) o36->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 560/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1781307307.634638:0:227328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f9571bd pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456907008:192.168.206.155@tcp:36:lfs.0 00000100:00100000:1.0:1781307307.634707:0:227328:0:(client.c:2500:ptlrpc_set_wait()) set 0000000052f01574 going to sleep for 30 seconds 00000100:00100000:1.0:1781307307.661731:0:227328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f9571bd pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227328:1867826456907008:192.168.206.155@tcp:36:lfs.0 00000080:00200000:1.0:1781307307.661811:0:227328:0:(llite_lib.c:2838:ll_read_inode2()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd) 00000080:00200000:1.0:1781307307.661819:0:227328:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323e:0x0], updating i_size 4096 00000080:00200000:1.0:1781307307.661858:0:227328:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4) 00000080:00200000:0.0:1781307307.688110:0:227332:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:0.0:1781307307.688151:0:227332:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1781307307.688176:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.688195:0:227332:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1781307307.688209:0:227332:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:0.0:1781307307.688220:0:227332:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ff5c0 00000080:00010000:0.0:1781307307.688229:0:227332:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ff5c0 from it 000000007e832bb4 00010000:00010000:0.0:1781307307.688233:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.688243:0:227332:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307307.688262:0:227332:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:0.0:1781307307.688279:0:227332:0:(namei.c:1111:ll_lookup_nd()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), flags=25 00000080:00200000:0.0:1781307307.688285:0:227332:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), intent=0 00000002:00010000:0.0:1781307307.688300:0:227332:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d818.sanity,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1781307307.688386:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.688396:0:227332:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.688409:0:227332:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307307.688445:0:227332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d9d9233 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456907072:192.168.206.155@tcp:101:lfs.0 00000100:00100000:0.0:1781307307.688652:0:227332:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 30 seconds 00000100:00100000:0.0:1781307307.700608:0:227332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d9d9233 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456907072:192.168.206.155@tcp:101:lfs.0 00010000:00010000:0.0:1781307307.700651:0:227332:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700686:0:227332:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700709:0:227332:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700723:0:227332:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700735:0:227332:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700750:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700759:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700766:0:227332:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307307.700778:0:227332:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@000000002d9d9233 x1867826456907072/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/688 e 0 to 0 dl 1781307338 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1781307307.700792:0:227332:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.700803:0:227332:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 4 res 8589945619/12862 (0 0) 00000080:00200000:0.0:1781307307.704088:0:227332:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323e:0x0], updating i_size 4096 00000080:00200000:0.0:1781307307.704103:0:227332:0:(namei.c:157:ll_iget()) got inode: [0x200002b13:0x323e:0x0](00000000b48957bd): rc = 0 00000080:00010000:0.0:1781307307.704125:0:227332:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) for lock 0x18761f4d8c4ffa35 00000080:00010000:0.0:1781307307.704144:0:227332:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) 00000080:00010000:0.0:1781307307.704175:0:227332:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa35 from it 000000006fc19418 00010000:00010000:0.0:1781307307.704182:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.704201:0:227332:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307307.704267:0:227332:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 1 00000080:00200000:0.0:1781307307.704295:0:227332:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 3 00000080:00200000:0.0:1781307307.704300:0:227332:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd), file 0000000072dd9c4c, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1781307307.704310:0:227332:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd), intent=open|creat 00000002:00010000:0.0:1781307307.704348:0:227332:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f818.sanity,[0x200002b13:0x323f:0x0]) in obj [0x200002b13:0x323e:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1781307307.704451:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 3/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.704472:0:227332:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 3/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1781307307.704488:0:227332:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1781307307.704502:0:227332:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002d9d9233 x1867826456907200/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1781307307.704512:0:227332:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 3/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307307.704543:0:227332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d9d9233 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456907200:192.168.206.155@tcp:101:lfs.0 00000100:00100000:0.0:1781307307.704819:0:227332:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 30 seconds 00000100:00100000:0.0:1781307307.712888:0:227332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d9d9233 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456907200:192.168.206.155@tcp:101:lfs.0 00010000:00010000:0.0:1781307307.713106:0:227332:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 4/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713138:0:227332:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 4/0,1 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713147:0:227332:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 4/0,1 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713160:0:227332:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 4/0,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713173:0:227332:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 4/0,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713188:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 5/1,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713197:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 5/1,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713204:0:227332:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 4/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307307.713214:0:227332:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@000000002d9d9233 x1867826456907200/t30064771284(30064771284) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/600 e 0 to 0 dl 1781307338 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1781307307.713226:0:227332:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@000000002d9d9233 x1867826456907200/t30064771284(30064771284) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/600 e 0 to 0 dl 1781307338 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1781307307.713236:0:227332:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307307.713254:0:227332:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 16 res 8589945619/12863 (0 0) 00000080:00200000:0.0:1781307307.713283:0:227332:0:(namei.c:1412:ll_create_it()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd), intent=open|creat 00000080:00200000:0.0:1781307307.713327:0:227332:0:(llite_lib.c:2838:ll_read_inode2()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e) 00000080:00200000:0.0:1781307307.713336:0:227332:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323f:0x0], updating i_size 0 00000080:00200000:0.0:1781307307.713427:0:227332:0:(file.c:5870:ll_layout_conf()) [0x200002b13:0x323f:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1781307307.713435:0:227332:0:(namei.c:1379:ll_create_node()) setting l_ast_data to inode [0x200002b13:0x323f:0x0](00000000d34dc47e) 00000080:00010000:0.0:1781307307.713439:0:227332:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323f:0x0](00000000d34dc47e) for lock 0x18761f4d8c4ffa3c 00000080:00200000:0.0:1781307307.713476:0:227332:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e), flags 120501 00000002:00100000:1.0:1781307307.713646:0:227332:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@000000002d9d9233 x1867826456907200/t30064771284(30064771284) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/600 e 0 to 0 dl 1781307338 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:1.0:1781307307.713717:0:227332:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa3c from it 0000000079dfee41 00010000:00010000:1.0:1781307307.713725:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.713748:0:227332:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307307.713768:0:227332:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e), inode mode 81a4 mask 40 00000080:00200000:1.0:1781307307.713806:0:227332:0:(file.c:4007:ll_file_ioctl()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e), cmd=4008669a 00000002:00010000:1.0:1781307307.713827:0:227332:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323f:0x0]) in obj [0x200002b13:0x323e:0x0], intent: open flags 040000002 00010000:00010000:1.0:1781307307.713878:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.713886:0:227332:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1781307307.713898:0:227332:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1781307307.713903:0:227332:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000fa551f45 x1867826456907328/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1781307307.713911:0:227332:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781307307.713932:0:227332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa551f45 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456907328:192.168.206.155@tcp:101:lfs.0 00000100:00100000:1.0:1781307307.714120:0:227332:0:(client.c:2500:ptlrpc_set_wait()) set 0000000052f01574 going to sleep for 30 seconds 00000100:00100000:2.0:1781307307.717288:0:2267:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.155@tcp (source: 12345-192.168.206.155@tcp) 00000100:00100000:3.0:1781307307.717451:0:130008:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867826435150592 00000100:00100000:3.0:1781307307.717524:0:130008:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.155@tcp, seq: 10648 00000100:00100000:3.0:1781307307.717531:0:130008:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000687b604f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f+5:113404:x1867826435150592:12345-192.168.206.155@tcp:104: 00010000:00010000:3.0:1781307307.717550:0:130008:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781307307.717628:0:130008:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1781307307.717633:0:130008:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000687b604f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f+5:113404:x1867826435150592:12345-192.168.206.155@tcp:104: Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1781307307.717640:0:130008:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.155@tcp, seq: 10648 00010000:00010000:1.0:1781307307.718270:0:147840:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781307307.718277:0:147840:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.718288:0:147840:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bd3ef3fb already unused, calling callback (00000000430e9631) 00010000:00010000:1.0:1781307307.718291:0:147840:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.718547:0:147840:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.718556:0:147840:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 3/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307307.718587:0:147840:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x323f:0x0]: losing layout lock 00010000:00010000:1.0:1781307307.718628:0:147840:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 2/0,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.718634:0:147840:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1781307307.718653:0:147840:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 1/0,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.718658:0:147840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd3ef3fb/0x18761f4d8c4ffa3c lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000020 nid: local remote: 0xe42db145352e539d expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307307.718675:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781307307.718676:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781307307.718677:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781307307.718684:0:2272:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781307307.718713:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9b215ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456907392:192.168.206.155@tcp:103:ldlm_bl_06.0 00000100:00100000:1.0:1781307307.726405:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9b215ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456907392:192.168.206.155@tcp:103:ldlm_bl_06.0 00010000:00010000:0.0:1781307308.387519:0:147843:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781307309.423896:0:147844:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1781307310.435656:0:197546:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307310.435663:0:197546:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1781307310.435791:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001cc0bd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907520:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307310.435862:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907648:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307310.435887:0:2273:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1781307310.435891:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bdf25af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456907456:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307310.435907:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907584:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00010000:0.0:1781307310.436247:0:147842:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781307310.453394:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bdf25af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456907456:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00080000:0.0:1781307310.453419:0:2273:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@000000006c8d7b45 x1867826456907584/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307341 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:0.0:1781307310.453431:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907584:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307310.453478:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001cc0bd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907520:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307310.453495:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907648:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00010000:0.0:1781307311.459704:0:144655:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307312.483974:0:130015:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781307313.507619:0:147841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307314.531868:0:147065:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1781307315.555756:0:197546:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307315.555765:0:197546:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1781307315.555854:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001cc0bd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907776:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307315.555966:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bdf25af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907904:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307315.556003:0:2273:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1781307315.556010:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456907712:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307315.556033:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907840:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1781307315.556147:0:130016:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781307315.561226:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456907712:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00080000:0.0:1781307315.561257:0:2273:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@000000006c8d7b45 x1867826456907840/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307346 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:0.0:1781307315.561269:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907840:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307315.561282:0:2273:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771284 gen 1 00000100:00100000:0.0:1781307315.561304:0:2273:0:(client.c:2899:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@000000002d9d9233 x1867826456907200/t30064771284(30064771284) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/600 e 0 to 0 dl 1781307338 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000100:00100000:0.0:1781307315.561667:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001cc0bd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907776:192.168.206.155@tcp:400:kworker/u8:0.0 00000100:00100000:0.0:1781307315.561702:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bdf25af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456907904:192.168.206.155@tcp:400:kworker/u8:0.0 00010000:00010000:3.0:1781307316.582316:0:147064:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781307317.605612:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307318.627599:0:147843:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781307319.662247:0:147844:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307320.675564:0:147842:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1781307320.675874:0:219767:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1781307320.675879:0:219767:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:3.0:1781307320.676029:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c9bb345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:c2ecee20-3525-4370-afdc-78c8998ef134:2274:1867826456907968:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781307320.676124:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dabee059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908096:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781307320.676154:0:2274:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1781307320.676160:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0ccddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908032:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781307320.676176:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9d7331f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908160:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307320.679444:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0ccddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908032:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307320.679466:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9d7331f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908160:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307320.679476:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c9bb345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:c2ecee20-3525-4370-afdc-78c8998ef134:2274:1867826456907968:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00080000:2.0:1781307320.679487:0:2274:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000dabee059 x1867826456908096/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307351 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:2.0:1781307320.679496:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dabee059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908096:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00010000:0.0:1781307321.699931:0:144655:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307322.723596:0:130015:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781307323.747732:0:147841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307324.771932:0:147065:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781307325.797304:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bdf25af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456908224:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:1.0:1781307325.805457:0:2272:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781307325.805490:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001cc0bd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456908288:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00080000:0.0:1781307325.823695:0:182823:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307325.823701:0:182823:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1781307325.823705:0:2273:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1781307325.823723:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456908352:192.168.206.155@tcp:400:kworker/u8:11.0 00010000:00010000:2.0:1781307325.823798:0:130016:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781307325.823834:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dabee059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908416:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:1.0:1781307325.826102:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bdf25af9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456908224:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:2.0:1781307325.836838:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dabee059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456908416:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:1.0:1781307325.838593:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001cc0bd6e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456908288:192.168.206.155@tcp:400:kworker/u8:11.0 00010000:00080000:0.0:1781307325.839511:0:2273:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@000000006c8d7b45 x1867826456908352/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307356 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:11.0' 00000100:00100000:0.0:1781307325.839527:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456908352:192.168.206.155@tcp:400:kworker/u8:11.0 00010000:00010000:3.0:1781307326.883616:0:147064:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781307327.876750:0:227332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa551f45 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456907328:192.168.206.155@tcp:101:lfs.0 00010000:00010000:1.0:1781307327.876776:0:227332:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876790:0:227332:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876796:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876803:0:227332:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 3/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876810:0:227332:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 4/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876817:0:227332:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001a79b29a already unused, calling callback (00000000430e9631) 00010000:00010000:1.0:1781307327.876835:0:227332:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 4/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876841:0:227332:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 4/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876849:0:227332:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 5/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876856:0:227332:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1781307327.876862:0:227332:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 3/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307327.876868:0:227332:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa43 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1781307327.876888:0:227332:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=800002b, status=0 req@00000000fa551f45 x1867826456907328/t30064771285(30064771285) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/656 e 0 to 0 dl 1781307338 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1781307327.876900:0:227332:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000fa551f45 x1867826456907328/t30064771285(30064771285) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/656 e 0 to 0 dl 1781307338 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1781307327.876952:0:227332:0:(vvp_io.c:1820:vvp_io_init()) [0x200002b13:0x323f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:1.0:1781307327.876960:0:227332:0:(vvp_io.c:313:vvp_io_fini()) [0x200002b13:0x323f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:1.0:1781307327.876998:0:227332:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323f:0x0], updating i_size 0 00000002:00100000:1.0:1781307327.877014:0:227332:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@00000000fa551f45 x1867826456907328/t30064771285(30064771285) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/656 e 0 to 0 dl 1781307338 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000002:00100000:1.0:1781307327.877034:0:227332:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@00000000fa551f45 x1867826456907328/t30064771285(30064771285) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/656 e 0 to 0 dl 1781307338 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'lfs.0' 00000020:00100000:1.0:1781307327.877059:0:227332:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1781307327.877070:0:227332:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d9b215ed x1867826456908544/t0(0) o35->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1781307327.877089:0:227332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d9b215ed pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456908544:192.168.206.155@tcp:35:lfs.0 00000100:00100000:1.0:1781307327.877159:0:227332:0:(client.c:2500:ptlrpc_set_wait()) set 0000000084eb6f55 going to sleep for 6 seconds 00000100:00100000:1.0:1781307327.889660:0:227332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d9b215ed pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456908544:192.168.206.155@tcp:35:lfs.0 00000002:00100000:1.0:1781307327.889697:0:227332:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@00000000fa551f45 x1867826456907328/t30064771285(30064771285) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/656 e 0 to 0 dl 1781307338 ref 2 fl Complete:RQU/4/0 rc 301/301 job:'lfs.0' 00000080:00010000:1.0:1781307327.889733:0:227332:0:(file.c:6087:ll_layout_intent()) ### lustre: requeue layout lock for file [0x200002b13:0x323f:0x0](00000000d34dc47e) 00000002:00010000:1.0:1781307327.889742:0:227332:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323f:0x0]) in obj [0x200002b13:0x323f:0x0], intent: layout flags 0 00010000:00010000:1.0:1781307327.889791:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.889800:0:227332:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.889809:0:227332:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00000100:00100000:1.0:1781307327.889827:0:227332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b0c6c7e pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456908608:192.168.206.155@tcp:101:lfs.0 00000100:00100000:1.0:1781307327.889894:0:227332:0:(client.c:2500:ptlrpc_set_wait()) set 0000000084eb6f55 going to sleep for 30 seconds 00010000:00010000:3.0:1781307327.913145:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1781307327.919911:0:227332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b0c6c7e pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456908608:192.168.206.155@tcp:101:lfs.0 00010000:00010000:1.0:1781307327.919946:0:227332:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 4/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.919963:0:227332:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 4/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00000002:00100000:1.0:1781307327.920004:0:227332:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=400 disposition=1, status=0 req@000000005b0c6c7e x1867826456908608/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 376/400 e 0 to 0 dl 1781307358 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1781307327.920014:0:227332:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: layout, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00000002:00010000:1.0:1781307327.920027:0:227332:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.920039:0:227332:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 16 res 8589945619/12863 (0 0) 00000080:00010000:1.0:1781307327.920063:0:227332:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323f:0x0](00000000d34dc47e) for lock 0x18761f4d8c4ffa4a 00000080:00010000:1.0:1781307327.920071:0:227332:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa4a from it 000000009a3e6077 00010000:00010000:1.0:1781307327.920075:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.920083:0:227332:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.920106:0:227332:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 2/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.920116:0:227332:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 2/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00000080:00010000:1.0:1781307327.920124:0:227332:0:(file.c:5975:ll_layout_lock_set()) ### file [0x200002b13:0x323f:0x0](00000000d34dc47e) being reconfigured ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1781307327.920163:0:227332:0:(file.c:5870:ll_layout_conf()) [0x200002b13:0x323f:0x0]: layout version change: 4294967294 -> 0 00010000:00010000:1.0:1781307327.920167:0:227332:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1781307327.920181:0:227332:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00000080:00200000:1.0:1781307327.920242:0:227332:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e) 00000002:00100000:1.0:1781307327.920277:0:227332:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@000000002d9d9233 x1867826456907200/t30064771284(30064771284) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/600 e 0 to 0 dl 1781307338 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:1.0:1781307327.920305:0:227332:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1781307327.920311:0:227332:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005b0c6c7e x1867826456908736/t0(0) o35->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1781307327.920333:0:227332:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b0c6c7e pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456908736:192.168.206.155@tcp:35:lfs.0 00000100:00100000:1.0:1781307327.920475:0:227332:0:(client.c:2500:ptlrpc_set_wait()) set 0000000084eb6f55 going to sleep for 6 seconds 00000100:00100000:1.0:1781307327.925443:0:227332:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b0c6c7e pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227332:1867826456908736:192.168.206.155@tcp:35:lfs.0 00000002:00100000:1.0:1781307327.925489:0:227332:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@000000002d9d9233 x1867826456907200/t30064771284(30064771284) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/600 e 0 to 0 dl 1781307338 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000080:00200000:0.0:1781307327.967355:0:227336:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:0.0:1781307327.967411:0:227336:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1781307327.967430:0:227336:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.967445:0:227336:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1781307327.967460:0:227336:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:0.0:1781307327.967464:0:227336:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ff5c0 00000080:00010000:0.0:1781307327.967472:0:227336:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ff5c0 from it 00000000e404d6f8 00010000:00010000:0.0:1781307327.967475:0:227336:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.967493:0:227336:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307327.967512:0:227336:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:0.0:1781307327.967521:0:227336:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d818.sanity, flags=25 00000080:00200000:0.0:1781307327.967527:0:227336:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 1 00000080:00200000:0.0:1781307327.967540:0:227336:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 3 00000080:00200000:0.0:1781307327.967545:0:227336:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd), file 0000000060da8d6b, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1781307327.967555:0:227336:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd), intent=open|creat 00000002:00010000:0.0:1781307327.967576:0:227336:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f818.sanity,[0x200002b13:0x3240:0x0]) in obj [0x200002b13:0x323e:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1781307327.967631:0:227336:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 3/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.967638:0:227336:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 3/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1781307327.967650:0:227336:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1781307327.967660:0:227336:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006c8d7b45 x1867826456908864/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/66264 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1781307327.967668:0:227336:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 3/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307327.967690:0:227336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227336:1867826456908864:192.168.206.155@tcp:101:lfs.0 00000100:00100000:0.0:1781307327.967983:0:227336:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 30 seconds 00000100:00100000:0.0:1781307327.975811:0:227336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c8d7b45 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227336:1867826456908864:192.168.206.155@tcp:101:lfs.0 00010000:00010000:0.0:1781307327.975990:0:227336:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 4/0,1 mode: --/CW res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976028:0:227336:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 4/0,1 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976035:0:227336:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 4/0,1 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976049:0:227336:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 4/0,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976062:0:227336:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 4/0,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976078:0:227336:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 5/1,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976088:0:227336:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 5/1,1 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976095:0:227336:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 4/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307327.976107:0:227336:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=2b, status=0 req@000000006c8d7b45 x1867826456908864/t30064771288(30064771288) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/656 e 0 to 0 dl 1781307358 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1781307327.976121:0:227336:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@000000006c8d7b45 x1867826456908864/t30064771288(30064771288) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 528/656 e 0 to 0 dl 1781307358 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1781307327.976137:0:227336:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: open|creat, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1781307327.976163:0:227336:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307327.976175:0:227336:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 16 res 8589945619/12863 (0 0) 00000080:00200000:0.0:1781307327.976226:0:227336:0:(namei.c:157:ll_iget()) got inode: [0x200002b13:0x323f:0x0](00000000d34dc47e): rc = 0 00000080:00200000:0.0:1781307327.976239:0:227336:0:(file.c:5870:ll_layout_conf()) [0x200002b13:0x323f:0x0]: layout version change: 0 -> 0 00000080:00010000:0.0:1781307327.976245:0:227336:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323f:0x0](00000000d34dc47e) for lock 0x18761f4d8c4ffa51 00000080:00010000:0.0:1781307327.976256:0:227336:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323f:0x0](00000000d34dc47e) 00000080:00200000:0.0:1781307327.976271:0:227336:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e), flags 120501 00000002:00100000:0.0:1781307327.976295:0:227336:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@000000006c8d7b45 x1867826456908864/t30064771288(30064771288) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/656 e 0 to 0 dl 1781307358 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1781307327.976519:0:227336:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa51 from it 00000000ee01e25d 00010000:00010000:0.0:1781307327.976524:0:227336:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307327.976535:0:227336:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307327.976553:0:227336:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e), inode mode 81a4 mask 42 00000080:00200000:0.0:1781307327.976595:0:227336:0:(file.c:4007:ll_file_ioctl()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e), cmd=4008669a 00000002:00010000:0.0:1781307327.976616:0:227336:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323f:0x0]) in obj [0x200002b13:0x323e:0x0], intent: open flags 040000002 00010000:00010000:0.0:1781307327.976667:0:227336:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.976674:0:227336:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1781307327.976772:0:227336:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1781307327.976779:0:227336:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a160b120 x1867826456908992/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1781307327.976787:0:227336:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307327.976810:0:227336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227336:1867826456908992:192.168.206.155@tcp:101:lfs.0 00000100:00100000:0.0:1781307327.986062:0:227336:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 30 seconds 00000100:00100000:0.0:1781307327.993841:0:227336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227336:1867826456908992:192.168.206.155@tcp:101:lfs.0 00010000:00010000:0.0:1781307327.993872:0:227336:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993887:0:227336:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993894:0:227336:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993902:0:227336:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 3/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993911:0:227336:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 4/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993917:0:227336:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000018b76b85 already unused, calling callback (00000000430e9631) 00010000:00010000:0.0:1781307327.993923:0:227336:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 4/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993951:0:227336:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 4/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993958:0:227336:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 5/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993965:0:227336:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1781307327.993971:0:227336:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 3/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307327.993977:0:227336:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000018b76b85/0x18761f4d8c4ffa58 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227336 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307327.993999:0:227336:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-17 req@00000000a160b120 x1867826456908992/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307358 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1781307327.994017:0:227336:0:(file.c:698:ll_intent_file_open()) lock enqueue: err: -17 00000080:00200000:0.0:1781307327.994274:0:227336:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e) 00000002:00100000:0.0:1781307327.994321:0:227336:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@000000006c8d7b45 x1867826456908864/t30064771288(30064771288) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/656 e 0 to 0 dl 1781307358 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1781307327.999546:0:227336:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1781307327.999576:0:227336:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a160b120 x1867826456909120/t0(0) o35->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1781307328.000760:0:227336:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227336:1867826456909120:192.168.206.155@tcp:35:lfs.0 00000100:00100000:3.0:1781307328.000880:0:227336:0:(client.c:2500:ptlrpc_set_wait()) set 0000000018121582 going to sleep for 6 seconds 00000100:00100000:3.0:1781307328.008403:0:227336:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a160b120 pname:cluuid:pid:xid:nid:opc:job lfs:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227336:1867826456909120:192.168.206.155@tcp:35:lfs.0 00000002:00100000:3.0:1781307328.008441:0:227336:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@000000006c8d7b45 x1867826456908864/t30064771288(30064771288) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/656 e 0 to 0 dl 1781307358 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:0.0:1781307328.934525:0:147843:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781307329.955728:0:147844:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1781307330.915740:0:219767:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1781307330.915747:0:219767:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1781307330.915778:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c9bb345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456909248:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307330.915866:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc0ccddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456909376:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307330.915890:0:2274:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1781307330.915894:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dabee059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:c2ecee20-3525-4370-afdc-78c8998ef134:2274:1867826456909184:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307330.915911:0:2274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b9d7331f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456909312:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781307330.921106:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dabee059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:c2ecee20-3525-4370-afdc-78c8998ef134:2274:1867826456909184:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:3.0:1781307330.921136:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc0ccddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456909376:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00080000:2.0:1781307330.922102:0:2274:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000b9d7331f x1867826456909312/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307361 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:2.0:1781307330.922119:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b9d7331f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456909312:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307330.922134:0:2274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c9bb345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2274:1867826456909248:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00010000:0.0:1781307330.979532:0:147842:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307332.008696:0:144655:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307333.030392:0:130015:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781307334.057141:0:147841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307335.080526:0:147065:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1781307336.035742:0:182823:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1781307336.035749:0:182823:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:2.0:1781307336.035834:0:2275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c45de94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:c2ecee20-3525-4370-afdc-78c8998ef134:2275:1867826456909440:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:2.0:1781307336.036224:0:2275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e34b8264 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2275:1867826456909568:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:2.0:1781307336.036273:0:2275:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1781307336.036279:0:2275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028783c20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2275:1867826456909504:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:2.0:1781307336.036314:0:2275:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000045221d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2275:1867826456909632:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00080000:2.0:1781307336.059617:0:2275:0:(recover.c:232:ptlrpc_request_handle_notconn()) import lustre-MDT0000-mdc-ffff959d07a83000 of lustre-MDT0000_UUID@192.168.206.155@tcp abruptly disconnected: reconnecting 00000100:00080000:2.0:1781307336.059627:0:2275:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1781307336.059636:0:2275:0:(import.c:200:ptlrpc_set_import_discon()) lustre-MDT0000-mdc-ffff959d07a83000: Connection to lustre-MDT0000 (at 192.168.206.155@tcp) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1781307336.091152:0:2275:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1781307336.091171:0:2275:0:(import.c:534:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: connect to NID 192.168.206.155@tcp last attempt 8667 00000100:00080000:2.0:1781307336.091197:0:2275:0:(import.c:615:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: import 00000000d816ce5c using connection 192.168.206.155@tcp/192.168.206.155@tcp 00000008:00100000:2.0:1781307336.091210:0:2275:0:(osc_request.c:3485:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34539520 ocd_grant: 2097152, lost: 0. 00000100:00100000:2.0:1781307336.091242:0:2275:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006c9bb345 x1867826456909696/t0(0) o38->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:2.0:1781307336.091277:0:2275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028783c20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2275:1867826456909504:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:2.0:1781307336.091328:0:2275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000045221d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2275:1867826456909632:192.168.206.155@tcp:400:kworker/u8:11.0 00010000:00080000:2.0:1781307336.091341:0:2275:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@00000000e34b8264 x1867826456909568/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307367 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:11.0' 00000100:00100000:2.0:1781307336.091349:0:2275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e34b8264 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2275:1867826456909568:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:0.0:1781307336.091440:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c9bb345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456909696:192.168.206.155@tcp:38:ptlrpcd_01_01.0 00010000:00010000:3.0:1781307336.099511:0:130016:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1781307336.119679:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1781307336.119691:0:2271:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.206.155@tcp failed (-19) 00000100:00100000:1.0:1781307336.119700:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c9bb345 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456909696:192.168.206.155@tcp:38:ptlrpcd_01_01.0 00010000:00010000:3.0:1781307337.125161:0:147064:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781307338.150721:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307339.171715:0:147843:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781307340.197087:0:147844:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1781307341.163746:0:182823:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307341.163756:0:182823:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1781307341.163760:0:182823:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1781307341.163772:0:182823:0:(import.c:534:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: connect to NID 192.168.206.155@tcp last attempt 9322 00000100:00080000:0.0:1781307341.163776:0:182823:0:(import.c:581:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: tried all connections, increasing latency to 6s 00000100:00080000:0.0:1781307341.163783:0:182823:0:(import.c:615:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: import 00000000d816ce5c using connection 192.168.206.155@tcp/192.168.206.155@tcp 00000008:00100000:0.0:1781307341.163794:0:182823:0:(osc_request.c:3485:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34539520 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1781307341.163810:0:182823:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004cb7ca1a x1867826456909824/t0(0) o38->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1781307341.163838:0:182823:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307341.163841:0:182823:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1781307341.163873:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e03e8dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456909760:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:0.0:1781307341.163963:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456909952:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:0.0:1781307341.163994:0:2273:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1781307341.163998:0:2273:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456909888:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:3.0:1781307341.164905:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004cb7ca1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456909824:192.168.206.155@tcp:38:kworker/u8:11.0 00010000:00080000:0.0:1781307341.180519:0:2273:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@00000000c8550649 x1867826456909888/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307372 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:11.0' 00000100:00100000:0.0:1781307341.180541:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456909888:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:0.0:1781307341.180558:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2273:1867826456909952:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00080000:1.0:1781307341.180642:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1781307341.180647:0:2271:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.206.155@tcp failed (-19) 00000100:00100000:1.0:1781307341.180652:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004cb7ca1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456909824:192.168.206.155@tcp:38:kworker/u8:11.0 00010000:00010000:0.0:1781307341.219719:0:147842:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307342.244627:0:144655:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1781307343.203594:0:2275:0:(client.c:2295:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1781307336/real 1781307336] req@000000002c45de94 x1867826456909440/t0(0) o400->MGC192.168.206.155@tcp@192.168.206.155@tcp:26/25 lens 224/224 e 0 to 1 dl 1781307343 ref 1 fl Rpc:XNQr/0/ffffffff rc 0/-1 job:'kworker/u8:11.0' 00000100:00100000:2.0:1781307343.224635:0:2275:0:(client.c:2339:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@000000002c45de94 x1867826456909440/t0(0) o400->MGC192.168.206.155@tcp@192.168.206.155@tcp:26/25 lens 224/224 e 0 to 1 dl 1781307343 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u8:11.0' 00000100:00080000:2.0:1781307343.224648:0:2275:0:(import.c:86:import_set_state_nolock()) 00000000d7f1d08c MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1781307343.224652:0:2275:0:(import.c:206:ptlrpc_set_import_discon()) 166-1: MGC192.168.206.155@tcp: Connection to MGS (at 192.168.206.155@tcp) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1781307343.245251:0:2275:0:(import.c:212:ptlrpc_set_import_discon()) import MGS@192.168.206.155@tcp for MGC192.168.206.155@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1781307343.245259:0:2275:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1781307343.245285:0:2275:0:(client.c:3295:ptlrpc_abort_inflight()) @@@ inflight req@000000002c45de94 x1867826456909440/t0(0) o400->MGC192.168.206.155@tcp@192.168.206.155@tcp:26/25 lens 224/224 e 0 to 1 dl 1781307343 ref 1 fl Rpc:XNQU/0/ffffffff rc 0/-1 job:'kworker/u8:11.0' 00000100:00100000:2.0:1781307343.245301:0:2275:0:(client.c:3295:ptlrpc_abort_inflight()) @@@ inflight req@00000000e03e8dd0 x1867826456909760/t0(0) o400->MGC192.168.206.155@tcp@192.168.206.155@tcp:26/25 lens 224/224 e 0 to 0 dl 1781307348 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'kworker/u8:11.0' 10000000:01000000:2.0:1781307343.245323:0:2275:0:(mgc_request.c:1332:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1781307343.245326:0:2275:0:(pinger.c:215:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1781307343.245346:0:2275:0:(mgc_request.c:1332:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1781307343.245348:0:2275:0:(import.c:434:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1781307343.245734:0:2273:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e03e8dd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c2ecee20-3525-4370-afdc-78c8998ef134:2273:1867826456909760:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00080000:1.0:1781307343.245800:0:182823:0:(pinger.c:251:ptlrpc_pinger_process_import()) c2ecee20-3525-4370-afdc-78c8998ef134->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1781307343.245805:0:182823:0:(recover.c:57:ptlrpc_initiate_recovery()) MGS: starting recovery 00000100:00080000:1.0:1781307343.245809:0:182823:0:(import.c:86:import_set_state_nolock()) 00000000d7f1d08c MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1781307343.245814:0:182823:0:(import.c:534:import_select_connection()) MGC192.168.206.155@tcp: connect to NID 192.168.206.155@tcp last attempt 8667 00000100:00080000:1.0:1781307343.245821:0:182823:0:(import.c:615:import_select_connection()) MGC192.168.206.155@tcp: import 00000000d7f1d08c using connection MGC192.168.206.155@tcp_0/192.168.206.155@tcp 00000100:00100000:1.0:1781307343.245851:0:182823:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a11952c4 x1867826456910016/t0(0) o250->MGC192.168.206.155@tcp@192.168.206.155@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1781307343.245869:0:182823:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1781307343.245872:0:182823:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1781307343.245874:0:182823:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1781307343.245878:0:182823:0:(import.c:534:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: connect to NID 192.168.206.155@tcp last attempt 9327 00000100:00080000:1.0:1781307343.245881:0:182823:0:(import.c:581:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: tried all connections, increasing latency to 11s 00000100:00080000:1.0:1781307343.245898:0:182823:0:(import.c:615:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: import 00000000d816ce5c using connection 192.168.206.155@tcp/192.168.206.155@tcp 00000008:00100000:1.0:1781307343.245908:0:182823:0:(osc_request.c:3485:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34539520 ocd_grant: 2097152, lost: 0. 00000100:00100000:1.0:1781307343.245930:0:182823:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a951356 x1867826456910080/t0(0) o38->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:1.0:1781307343.245957:0:182823:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1781307343.245961:0:182823:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1781307343.245996:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a11952c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c2ecee20-3525-4370-afdc-78c8998ef134:2271:1867826456910016:192.168.206.155@tcp:250:kworker/u8:11.0 00000100:00100000:1.0:1781307343.246079:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a951356 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456910080:192.168.206.155@tcp:38:kworker/u8:11.0 00000100:00100000:1.0:1781307343.246124:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050892fcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456910144:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:1.0:1781307343.246170:0:2272:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1781307343.246184:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000702adfa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456910208:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00100000:2.0:1781307343.247156:0:2275:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c45de94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:c2ecee20-3525-4370-afdc-78c8998ef134:2275:1867826456909440:192.168.206.155@tcp:400:kworker/u8:11.0 00000100:00080000:1.0:1781307343.251583:0:2271:0:(import.c:1074:ptlrpc_connect_interpret()) MGC192.168.206.155@tcp: connect to target with instance 0 10000000:01000000:1.0:1781307343.251602:0:2271:0:(mgc_request.c:1332:mgc_import_event()) import event 0x808005 00000100:02000400:1.0:1781307343.251605:0:2271:0:(import.c:1234:ptlrpc_connect_interpret()) Evicted from MGS (at 192.168.206.155@tcp) after server handle changed from 0xe42db145352e3bf6 to 0xe42db145352e540d 00000100:00080000:1.0:1781307343.266384:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d7f1d08c MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:1.0:1781307343.266397:0:2271:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) evicted from MGS@192.168.206.155@tcp; invalidating 00000100:00100000:0.0:1781307343.267858:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a11952c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c2ecee20-3525-4370-afdc-78c8998ef134:2271:1867826456910016:192.168.206.155@tcp:250:kworker/u8:11.0 00000100:00080000:1.0:1781307343.268145:0:227474:0:(import.c:1514:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.206.155@tcp to MGS@192.168.206.155@tcp 00000100:00100000:1.0:1781307343.268150:0:227474:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1781307343.268154:0:227474:0:(mgc_request.c:1332:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1781307343.268167:0:227474:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: 000000008b892972/0x18761f4d8c4ff382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xe42db145352e3cd6 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1781307343.268177:0:227474:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: 000000008b892972/0x18761f4d8c4ff382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xe42db145352e3cd6 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1781307343.268182:0:227474:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1781307343.268193:0:227474:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1781307343.268200:0:227474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: 000000008b892972/0x18761f4d8c4ff382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xe42db145352e3cd6 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307343.268213:0:227474:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: 000000008857570b/0x18761f4d8c4ff390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe42db145352e3ce4 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1781307343.268218:0:227474:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: 000000008857570b/0x18761f4d8c4ff390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe42db145352e3ce4 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1781307343.268223:0:227474:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1781307343.268238:0:227474:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1781307343.268240:0:227474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: 000000008857570b/0x18761f4d8c4ff390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe42db145352e3ce4 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307343.268287:0:227474:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: 00000000b60ae217/0x18761f4d8c4ff39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe42db145352e3f22 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1781307343.268293:0:227474:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: 00000000b60ae217/0x18761f4d8c4ff39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe42db145352e3f22 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1781307343.268297:0:227474:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1781307343.268303:0:227474:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1781307343.268306:0:227474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: 00000000b60ae217/0x18761f4d8c4ff39e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe42db145352e3f22 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307343.268320:0:227474:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: 000000005c290930/0x18761f4d8c4ff389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xe42db145352e3cdd expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1781307343.268326:0:227474:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: 000000005c290930/0x18761f4d8c4ff389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xe42db145352e3cdd expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1781307343.268330:0:227474:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1781307343.268336:0:227474:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1781307343.268338:0:227474:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: 000000005c290930/0x18761f4d8c4ff389 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xe42db145352e3cdd expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1781307343.268356:0:227474:0:(import.c:86:import_set_state_nolock()) 00000000d7f1d08c MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1781307343.268388:0:227474:0:(import.c:86:import_set_state_nolock()) 00000000d7f1d08c MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1781307343.268390:0:227474:0:(mgc_request.c:1332:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1781307343.268395:0:227474:0:(pinger.c:208:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1781307343.268398:0:227474:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) MGC192.168.206.155@tcp: Connection restored to 192.168.206.155@tcp (at 192.168.206.155@tcp) 00010000:00010000:0.0:1781307343.269299:0:130015:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1781307343.273838:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1781307343.273851:0:2271:0:(import.c:1429:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.206.155@tcp failed (-19) 00000100:00100000:2.0:1781307343.273861:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a951356 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456910080:192.168.206.155@tcp:38:kworker/u8:11.0 00000100:00100000:0.0:1781307343.274331:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000702adfa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456910208:192.168.206.155@tcp:400:kworker/u8:11.0 00010000:00080000:0.0:1781307343.274346:0:2272:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@0000000050892fcd x1867826456910144/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307374 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:11.0' 00000100:00100000:0.0:1781307343.274354:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050892fcd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456910144:192.168.206.155@tcp:400:kworker/u8:11.0 00010000:00010000:2.0:1781307344.292349:0:147841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1781307344.931850:0:130019:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:0.0:1781307344.931861:0:130019:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-cliir-ffff959d07a83000 from 41 10000000:01000000:0.0:1781307344.931867:0:130019:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:0.0:1781307344.931923:0:130019:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307344.931937:0:130019:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307344.931948:0:130019:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307344.931982:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910272:192.168.206.155@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1781307344.932086:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 6 seconds 00000100:00100000:0.0:1781307344.936451:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910272:192.168.206.155@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1781307344.936487:0:130019:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307344.936512:0:130019:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307344.936601:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910336:192.168.206.155@tcp:256:ll_cfg_requeue.0 00000100:00100000:0.0:1781307344.936732:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 6 seconds 00000100:00100000:0.0:1781307344.963180:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910336:192.168.206.155@tcp:256:ll_cfg_requeue.0 10000000:01000000:0.0:1781307344.963231:0:130019:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:0.0:1781307344.963239:0:130019:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307344.963261:0:130019:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1781307344.963270:0:130019:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1781307344.963272:0:130019:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-client-ffff959d07a83000 from 128 10000000:01000000:0.0:1781307344.963275:0:130019:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1781307344.963311:0:130019:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 0000000046c9d8ff/0x18761f4d8c4ffa66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307344.963318:0:130019:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 0000000046c9d8ff/0x18761f4d8c4ffa66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307344.963326:0:130019:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 0000000046c9d8ff/0x18761f4d8c4ffa66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307344.963346:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910400:192.168.206.155@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1781307344.963434:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 6 seconds 00000100:00100000:0.0:1781307344.965410:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910400:192.168.206.155@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1781307344.965436:0:130019:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 0000000046c9d8ff/0x18761f4d8c4ffa66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e541b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307344.965462:0:130019:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 0000000046c9d8ff/0x18761f4d8c4ffa66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe42db145352e541b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307344.965537:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910464:192.168.206.155@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1781307344.965648:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 6 seconds 00000100:00100000:0.0:1781307344.975355:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910464:192.168.206.155@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1781307344.975439:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910528:192.168.206.155@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1781307344.975526:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 6 seconds 00000100:00100000:0.0:1781307344.983077:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910528:192.168.206.155@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1781307344.984199:0:227476:0:(llog.c:789:llog_process_thread()) stop processing plain 0x3:10:0 index 64768 count 126 00000020:01000000:1.0:1781307344.986166:0:130019:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 128-127 (rc=0) 10000000:01000000:1.0:1781307344.986203:0:130019:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1781307344.986225:0:130019:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 0000000046c9d8ff/0x18761f4d8c4ffa66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e541b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307344.986267:0:130019:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 0000000046c9d8ff/0x18761f4d8c4ffa66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e541b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1781307344.986277:0:130019:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1781307344.986280:0:130019:0:(mgc_request.c:2066:mgc_process_log()) Process log params-ffff959d07a83000 from 7 10000000:01000000:1.0:1781307344.986282:0:130019:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1781307344.986319:0:130019:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 00000000b0cf14b3/0x18761f4d8c4ffa6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307344.986326:0:130019:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 00000000b0cf14b3/0x18761f4d8c4ffa6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307344.986334:0:130019:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 00000000b0cf14b3/0x18761f4d8c4ffa6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781307344.986358:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910592:192.168.206.155@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1781307344.986488:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d92a35b8 going to sleep for 6 seconds 00000100:00100000:1.0:1781307344.989044:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910592:192.168.206.155@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1781307344.989072:0:130019:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 00000000b0cf14b3/0x18761f4d8c4ffa6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5422 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307344.989084:0:130019:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 00000000b0cf14b3/0x18761f4d8c4ffa6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe42db145352e5422 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781307344.989160:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910656:192.168.206.155@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1781307344.989428:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d92a35b8 going to sleep for 6 seconds 00000100:00100000:1.0:1781307344.997841:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910656:192.168.206.155@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1781307344.998051:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910720:192.168.206.155@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1781307344.998310:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d92a35b8 going to sleep for 6 seconds 00000100:00100000:1.0:1781307345.010205:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910720:192.168.206.155@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1781307345.012206:0:227477:0:(llog.c:789:llog_process_thread()) stop processing plain 0x2:10:0 index 64768 count 7 00000020:01000000:0.0:1781307345.014319:0:130019:0:(obd_config.c:2041:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1781307345.014355:0:130019:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1781307345.015427:0:130019:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 00000000b0cf14b3/0x18761f4d8c4ffa6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5422 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307345.015445:0:130019:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 00000000b0cf14b3/0x18761f4d8c4ffa6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5422 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1781307345.015456:0:130019:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1781307345.015459:0:130019:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-sptlrpc-ffff959d0357be88 from 1 10000000:01000000:0.0:1781307345.015461:0:130019:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1781307345.015504:0:130019:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 000000002a221b8d/0x18761f4d8c4ffa74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307345.015511:0:130019:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 000000002a221b8d/0x18761f4d8c4ffa74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307345.015545:0:130019:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 000000002a221b8d/0x18761f4d8c4ffa74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307345.015574:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910784:192.168.206.155@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1781307345.015663:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bb50c96 going to sleep for 6 seconds 00000100:00100000:1.0:1781307345.018689:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d7f0a9f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910784:192.168.206.155@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1781307345.018720:0:130019:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 000000002a221b8d/0x18761f4d8c4ffa74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5429 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307345.018733:0:130019:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 000000002a221b8d/0x18761f4d8c4ffa74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe42db145352e5429 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781307345.018818:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910848:192.168.206.155@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1781307345.018898:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 00000000372dcf15 going to sleep for 6 seconds 00000100:00100000:1.0:1781307345.022573:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456910848:192.168.206.155@tcp:501:ll_cfg_requeue.0 10000000:01000000:1.0:1781307345.022637:0:130019:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1781307345.022646:0:130019:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 000000002a221b8d/0x18761f4d8c4ffa74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5429 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307345.022657:0:130019:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 000000002a221b8d/0x18761f4d8c4ffa74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e5429 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307345.315811:0:147065:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781307346.340693:0:130016:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1781307347.365108:0:147064:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1781307347.636689:0:2267:0:(events.c:361:request_in_callback()) peer: 12345-192.168.206.155@tcp (source: 12345-192.168.206.155@tcp) 00000100:00100000:3.0:1781307347.636812:0:140799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1867826435161856 00000100:00100000:3.0:1781307347.636862:0:140799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.155@tcp, seq: 10649 00000100:00100000:3.0:1781307347.636868:0:140799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d7331f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:c2ecee20-3525-4370-afdc-78c8998ef134+3:166555:x1867826435161856:12345-192.168.206.155@tcp:104: 00010000:00010000:3.0:1781307347.636883:0:140799:0:(ldlm_lockd.c:2468:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781307347.636953:0:140799:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1781307347.636958:0:140799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d7331f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:c2ecee20-3525-4370-afdc-78c8998ef134+3:166555:x1867826435161856:12345-192.168.206.155@tcp:104: Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1781307347.636965:0:140799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.155@tcp, seq: 10649 00010000:00010000:1.0:1781307347.637962:0:147840:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1781307347.637971:0:147840:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307347.637981:0:147840:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000018b76b85 already unused, calling callback (00000000e28cfb9b) 10000000:00010000:1.0:1781307347.637994:0:147840:0:(mgc_request.c:1021:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307347.638002:0:147840:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1781307347.638008:0:147840:0:(mgc_request.c:1027:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1781307347.638012:0:147840:0:(mgc_request.c:1031:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1781307347.638064:0:147840:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307347.638069:0:147840:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1781307347.638085:0:147840:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307347.638090:0:147840:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.155@tcp lock: 0000000018b76b85/0x18761f4d8c4ffa5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe42db145352e5414 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307347.638113:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781307347.638114:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781307347.638115:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1781307347.638615:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456910912:192.168.206.155@tcp:103:ldlm_bl_06.0 00000100:00100000:0.0:1781307347.650839:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a3ed6adb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456910912:192.168.206.155@tcp:103:ldlm_bl_06.0 00000100:00080000:0.0:1781307348.325188:0:219767:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307348.325195:0:219767:0:(recover.c:57:ptlrpc_initiate_recovery()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1781307348.325198:0:219767:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1781307348.325208:0:219767:0:(import.c:534:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: connect to NID 192.168.206.155@tcp last attempt 9329 00000100:00080000:0.0:1781307348.325212:0:219767:0:(import.c:581:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: tried all connections, increasing latency to 16s 00000100:00080000:0.0:1781307348.325217:0:219767:0:(import.c:615:import_select_connection()) lustre-MDT0000-mdc-ffff959d07a83000: import 00000000d816ce5c using connection 192.168.206.155@tcp/192.168.206.155@tcp 00000008:00100000:0.0:1781307348.325227:0:219767:0:(osc_request.c:3485:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34539520 ocd_grant: 2097152, lost: 0. 00000100:00100000:0.0:1781307348.325255:0:219767:0:(import.c:807:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000079cfe3f9 x1867826456911040/t0(0) o38->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' 00000100:00080000:0.0:1781307348.325286:0:219767:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307348.325289:0:219767:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:0.0:1781307348.325319:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911104:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781307348.325438:0:2272:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1781307348.325445:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456910976:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781307348.325482:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2d824fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911168:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:2.0:1781307348.327392:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000079cfe3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911040:192.168.206.155@tcp:38:kworker/u8:1.0 00000100:00100000:0.0:1781307348.338256:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456910976:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:0.0:1781307348.338283:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2d824fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911168:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00080000:0.0:1781307348.338295:0:2272:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@0000000064f5f89e x1867826456911104/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307379 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1781307348.338305:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911104:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00080000:2.0:1781307348.350548:0:2271:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@0000000079cfe3f9 x1867826456911040/t0(0) o38->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 520/416 e 0 to 0 dl 1781307369 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:2.0:1781307348.350567:0:2271:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771289 gen 1 00000100:00080000:2.0:1781307348.350704:0:2271:0:(import.c:1074:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff959d07a83000: connect to target with instance 8 00000100:00080000:2.0:1781307348.350723:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1781307348.350729:0:2271:0:(import.c:1598:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1781307348.350731:0:2271:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771289 gen 1 00000100:00080000:2.0:1781307348.350734:0:2271:0:(recover.c:86:ptlrpc_replay_next()) import 00000000d816ce5c from lustre-MDT0000_UUID committed 30064771289 last 0 00000100:00080000:2.0:1781307348.350741:0:2271:0:(client.c:3262:ptlrpc_replay_req()) @@@ REPLAY req@00000000ed386d6b x1867826456835968/t30064771144(30064771144) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 632/712 e 0 to 0 dl 1781306841 ref 1 fl New:RPQU/4/ffffffff rc 0/-1 job:'dd.0' 00000100:00100000:2.0:1781307348.350752:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000079cfe3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911040:192.168.206.155@tcp:38:kworker/u8:1.0 00000100:00100000:2.0:1781307348.350776:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed386d6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456835968:192.168.206.155@tcp:101:dd.0 00010000:00010000:0.0:1781307348.387631:0:147843:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1781307348.412825:0:2271:0:(client.c:3151:ptlrpc_replay_interpret()) @@@ got reply req@00000000ed386d6b x1867826456835968/t30064771144(30064771144) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 632/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'dd.0' 00000002:00080000:2.0:1781307348.412849:0:2271:0:(mdc_request.c:719:mdc_replay_open()) updating handle from 0xe42db145352e48f3 to 0xe42db145352e5548 00000100:00020000:2.0:1781307348.412871:0:2271:0:(client.c:3161:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@00000000ed386d6b x1867826456835968/t30064771144(30064771144) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 632/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'dd.0' 00000100:00080000:2.0:1781307348.454795:0:2271:0:(import.c:1598:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1781307348.454806:0:2271:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771289 gen 1 00000100:00080000:2.0:1781307348.454816:0:2271:0:(recover.c:86:ptlrpc_replay_next()) import 00000000d816ce5c from lustre-MDT0000_UUID committed 30064771289 last 30064771144 00000100:00080000:2.0:1781307348.454837:0:2271:0:(client.c:3262:ptlrpc_replay_req()) @@@ REPLAY req@00000000a32b42af x1867826456838144/t30064771154(30064771154) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/656 e 0 to 0 dl 1781306850 ref 1 fl New:RPQU/4/ffffffff rc 0/-1 job:'md5sum.0' 00000100:00100000:2.0:1781307348.454858:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed386d6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456835968:192.168.206.155@tcp:101:dd.0 00000100:00100000:2.0:1781307348.454898:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a32b42af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456838144:192.168.206.155@tcp:101:md5sum.0 00000100:00080000:0.0:1781307348.478258:0:2271:0:(client.c:3151:ptlrpc_replay_interpret()) @@@ got reply req@00000000a32b42af x1867826456838144/t30064771154(30064771154) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'md5sum.0' 00000002:00080000:0.0:1781307348.478284:0:2271:0:(mdc_request.c:719:mdc_replay_open()) updating handle from 0xe42db145352e4955 to 0xe42db145352e55f0 00000100:00020000:0.0:1781307348.478289:0:2271:0:(client.c:3161:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@00000000a32b42af x1867826456838144/t30064771154(30064771154) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'md5sum.0' 00000100:00080000:0.0:1781307348.478298:0:2271:0:(import.c:1598:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1781307348.478300:0:2271:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771289 gen 1 00000100:00080000:0.0:1781307348.478306:0:2271:0:(recover.c:86:ptlrpc_replay_next()) import 00000000d816ce5c from lustre-MDT0000_UUID committed 30064771289 last 30064771154 00000100:00080000:0.0:1781307348.478314:0:2271:0:(client.c:3262:ptlrpc_replay_req()) @@@ REPLAY req@00000000109783cc x1867826456899136/t30064771272(30064771272) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/656 e 0 to 0 dl 1781307252 ref 1 fl New:RPQU/4/ffffffff rc 0/-1 job:'cp.0' 00000100:00100000:0.0:1781307348.478326:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a32b42af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456838144:192.168.206.155@tcp:101:md5sum.0 00000100:00100000:0.0:1781307348.478399:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000109783cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456899136:192.168.206.155@tcp:101:cp.0 00000100:00080000:0.0:1781307348.482397:0:2271:0:(client.c:3151:ptlrpc_replay_interpret()) @@@ got reply req@00000000109783cc x1867826456899136/t30064771272(30064771272) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'cp.0' 00000002:00080000:0.0:1781307348.482422:0:2271:0:(mdc_request.c:719:mdc_replay_open()) updating handle from 0xe42db145352e5215 to 0xe42db145352e5628 00000100:00020000:0.0:1781307348.482442:0:2271:0:(client.c:3161:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@00000000109783cc x1867826456899136/t30064771272(30064771272) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'cp.0' 00000100:00080000:0.0:1781307348.482450:0:2271:0:(import.c:1598:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1781307348.482452:0:2271:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771289 gen 1 00000100:00080000:0.0:1781307348.482456:0:2271:0:(recover.c:86:ptlrpc_replay_next()) import 00000000d816ce5c from lustre-MDT0000_UUID committed 30064771289 last 30064771272 00000100:00080000:0.0:1781307348.482462:0:2271:0:(client.c:3262:ptlrpc_replay_req()) @@@ REPLAY req@000000005873f4b1 x1867826456900032/t30064771275(30064771275) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/656 e 0 to 0 dl 1781307252 ref 1 fl New:RPQU/4/ffffffff rc 0/-1 job:'diff.0' 00000100:00100000:0.0:1781307348.482473:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000109783cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456899136:192.168.206.155@tcp:101:cp.0 00000100:00100000:0.0:1781307348.482496:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005873f4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456900032:192.168.206.155@tcp:101:diff.0 00000100:00080000:0.0:1781307348.486246:0:2271:0:(client.c:3151:ptlrpc_replay_interpret()) @@@ got reply req@000000005873f4b1 x1867826456900032/t30064771275(30064771275) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'diff.0' 00000002:00080000:0.0:1781307348.486265:0:2271:0:(mdc_request.c:719:mdc_replay_open()) updating handle from 0xe42db145352e5277 to 0xe42db145352e5636 00000100:00020000:0.0:1781307348.486268:0:2271:0:(client.c:3161:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@000000005873f4b1 x1867826456900032/t30064771275(30064771275) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'diff.0' 00000100:00080000:0.0:1781307348.486275:0:2271:0:(import.c:1598:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1781307348.486278:0:2271:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771289 gen 1 00000100:00080000:0.0:1781307348.486281:0:2271:0:(recover.c:86:ptlrpc_replay_next()) import 00000000d816ce5c from lustre-MDT0000_UUID committed 30064771289 last 30064771275 00000100:00080000:0.0:1781307348.486287:0:2271:0:(client.c:3262:ptlrpc_replay_req()) @@@ REPLAY req@0000000024e4c571 x1867826456901184/t30064771278(30064771278) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/656 e 0 to 0 dl 1781307259 ref 1 fl New:RPQU/4/ffffffff rc 0/-1 job:'writeme.0' 00000100:00100000:0.0:1781307348.486300:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005873f4b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456900032:192.168.206.155@tcp:101:diff.0 00000100:00100000:0.0:1781307348.486323:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024e4c571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456901184:192.168.206.155@tcp:101:writeme.0 00000100:00080000:0.0:1781307348.489451:0:2271:0:(client.c:3151:ptlrpc_replay_interpret()) @@@ got reply req@0000000024e4c571 x1867826456901184/t30064771278(30064771278) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'writeme.0' 00000002:00080000:0.0:1781307348.489470:0:2271:0:(mdc_request.c:719:mdc_replay_open()) updating handle from 0xe42db145352e52b6 to 0xe42db145352e5644 00000100:00020000:0.0:1781307348.489489:0:2271:0:(client.c:3161:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@0000000024e4c571 x1867826456901184/t30064771278(30064771278) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/600 e 0 to 0 dl 1781307379 ref 2 fl Interpret:RPQU/4/0 rc 301/301 job:'writeme.0' 00000100:00080000:0.0:1781307348.489497:0:2271:0:(import.c:1598:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1781307348.489499:0:2271:0:(client.c:2868:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff959d07a83000: committing for last_committed 30064771289 gen 1 00000100:00080000:0.0:1781307348.489504:0:2271:0:(recover.c:86:ptlrpc_replay_next()) import 00000000d816ce5c from lustre-MDT0000_UUID committed 30064771289 last 30064771278 00000100:00080000:0.0:1781307348.489507:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1781307348.489876:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024e4c571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456901184:192.168.206.155@tcp:101:writeme.0 00010000:00080000:0.0:1781307348.490122:0:227487:0:(ldlm_request.c:2680:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-mdc-ffff959d07a83000 to lustre-MDT0000_UUID@192.168.206.155@tcp 00010000:00010000:0.0:1781307348.490127:0:227487:0:(ldlm_request.c:2600:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-mdc-ffff959d07a83000 (31) 00000080:00200000:0.0:1781307348.490150:0:227487:0:(vvp_io.c:1820:vvp_io_init()) [0x200002b13:0x3232:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1781307348.490167:0:227487:0:(vvp_io.c:313:vvp_io_fini()) [0x200002b13:0x3232:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:0.0:1781307348.490229:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x323f:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490278:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004df00661/0x18761f4d8c4ffa51 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e53dc expref: -99 pid: 227336 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490299:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000009981e5d/0x18761f4d8c4ff5c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e4828 expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307348.490314:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x323f:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490319:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000001a79b29a/0x18761f4d8c4ffa4a lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e53c0 expref: -99 pid: 227332 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490342:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000010942456/0x18761f4d8c4ffa35 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e5381 expref: -99 pid: 227332 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307348.490358:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x323d:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490460:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000016fa3eb8/0x18761f4d8c4ffa12 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e5311 expref: -99 pid: 225552 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307348.490490:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x323d:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490495:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000f9464cc2/0x18761f4d8c4ffa0b lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e52f5 expref: -99 pid: 225545 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490511:0:227487:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000009781c98b/0x18761f4d8c4ff9f6 lrc: 2/0,0 mode: CW/CW res: [0x200002b13:0x323c:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e52af expref: -99 pid: 224966 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490520:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000006067b05b/0x18761f4d8c4ff9e8 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e5293 expref: -99 pid: 224961 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490531:0:227487:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000fbab4f27/0x18761f4d8c4ff9e1 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e5270 expref: -99 pid: 224394 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490549:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a9f03596/0x18761f4d8c4ff9c5 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e5246 expref: -99 pid: 224393 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490561:0:227487:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000104b03af/0x18761f4d8c4ff9b7 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e520e expref: -99 pid: 224393 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490576:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000bd7a4850/0x18761f4d8c4ff9a9 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e51eb expref: -99 pid: 224393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307348.490593:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000cf165988/0x18761f4d8c4ff9da lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e5262 expref: -99 pid: 224393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307348.490602:0:227487:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000fbab4f27/0x18761f4d8c4ff9e1 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323b:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e5270 expref: -99 pid: 224394 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490621:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000003a1a589c/0x18761f4d8c4ff9be lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e5231 expref: -99 pid: 224393 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490634:0:227487:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000104b03af/0x18761f4d8c4ff9b7 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e520e expref: -99 pid: 224393 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490642:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000eba3706a/0x18761f4d8c4ff986 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323a:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e5190 expref: -99 pid: 224389 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490656:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000eb5119ee/0x18761f4d8c4ff99b lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e51c8 expref: -99 pid: 224248 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307348.490672:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3237:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490681:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000000cd8038c/0x18761f4d8c4ff90f lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3237:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e4fbb expref: -99 pid: 222008 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307348.490698:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3236:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490708:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000c0b2b8a0/0x18761f4d8c4ff8ec lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3236:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e4f3d expref: -99 pid: 220363 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307348.490717:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3236:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490721:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000005f1dce68/0x18761f4d8c4ff8e5 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x3236:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e4f21 expref: -99 pid: 220354 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307348.490736:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3235:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490745:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000d0f86c4f/0x18761f4d8c4ff8c9 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3235:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e4edb expref: -99 pid: 218722 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307348.490772:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3235:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.490779:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000618a74f1/0x18761f4d8c4ff8c2 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x3235:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e4ebf expref: -99 pid: 218709 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490792:0:227487:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000005713ce0a/0x18761f4d8c4ff614 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x3234:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e494e expref: -99 pid: 217899 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490810:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000006755303b/0x18761f4d8c4ff8a6 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3234:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e4e79 expref: -99 pid: 217997 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490821:0:227487:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000005713ce0a/0x18761f4d8c4ff614 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x3234:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e494e expref: -99 pid: 217899 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490829:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000005ab58e11/0x18761f4d8c4ff606 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x3234:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e4932 expref: -99 pid: 217898 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.490842:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000004d69e50a/0x18761f4d8c4ff630 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3234:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e498d expref: -99 pid: 217902 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307348.490880:0:227487:0:(vvp_io.c:1820:vvp_io_init()) [0x200002b13:0x3232:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00000080:00200000:0.0:1781307348.491100:0:227487:0:(vvp_io.c:313:vvp_io_fini()) [0x200002b13:0x3232:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:0.0:1781307348.491110:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3232:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.491117:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000ba167267/0x18761f4d8c4ff5f1 lrc: 0/0,0 mode: --/PW res: [0x200002b13:0x3232:0x0].0x0 bits 0x48/0x0 rrc: 4 type: IBT gid 0 flags: 0x804829400000000 nid: local remote: 0xe42db145352e48d0 expref: -99 pid: 217306 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.491134:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000d8bc4539/0x18761f4d8c4ff5ff lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3232:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e4901 expref: -99 pid: 217308 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307348.491162:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000071bb7938/0x18761f4d8c4ff5ce lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3231:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xe42db145352e484b expref: -99 pid: 216620 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307348.491178:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3231:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.491191:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000f819175e/0x18761f4d8c4ff5b9 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x3231:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e480c expref: -99 pid: 216614 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307348.491209:0:227487:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x3230:0x0]: losing layout lock 00010000:00010000:0.0:1781307348.491217:0:227487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ff581 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x3230:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000000 nid: local remote: 0xe42db145352e46f4 expref: -99 pid: 215877 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307348.491226:0:227487:0:(ldlm_request.c:2613:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-mdc-ffff959d07a83000 00010000:00010000:0.0:1781307348.491716:0:227487:0:(ldlm_request.c:2572:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000009781c98b/0x18761f4d8c4ff9f6 lrc: 2/0,0 mode: CW/CW res: [0x200002b13:0x323c:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e52af expref: -99 pid: 224966 timeout: 0 lvb_type: 3 00010000:00080000:0.0:1781307348.491748:0:227487:0:(ldlm_request.c:2622:lock_can_replay()) check lock replay limit, inflights = 1(8) 00010000:00010000:0.0:1781307348.491756:0:227487:0:(ldlm_request.c:2572:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000fbab4f27/0x18761f4d8c4ff9e1 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323b:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e5270 expref: -99 pid: 224394 timeout: 0 lvb_type: 3 00010000:00080000:0.0:1781307348.491763:0:227487:0:(ldlm_request.c:2622:lock_can_replay()) check lock replay limit, inflights = 2(8) 00010000:00010000:0.0:1781307348.491767:0:227487:0:(ldlm_request.c:2572:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000104b03af/0x18761f4d8c4ff9b7 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323a:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e520e expref: -99 pid: 224393 timeout: 0 lvb_type: 3 00010000:00080000:0.0:1781307348.491773:0:227487:0:(ldlm_request.c:2622:lock_can_replay()) check lock replay limit, inflights = 3(8) 00010000:00010000:0.0:1781307348.491777:0:227487:0:(ldlm_request.c:2572:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000005713ce0a/0x18761f4d8c4ff614 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x3234:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e494e expref: -99 pid: 217899 timeout: 0 lvb_type: 3 00010000:00080000:0.0:1781307348.491782:0:227487:0:(ldlm_request.c:2622:lock_can_replay()) check lock replay limit, inflights = 4(8) 00010000:00010000:0.0:1781307348.491786:0:227487:0:(ldlm_request.c:2572:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000651dd250/0x18761f4d8c4ff5f8 lrc: 2/0,0 mode: CW/CW res: [0x200002b13:0x3232:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e48ec expref: -99 pid: 217308 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1781307348.491799:0:227487:0:(ldlm_request.c:2622:lock_can_replay()) check lock replay limit, inflights = 5(8) 00000100:00100000:2.0:1781307348.492341:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911232:192.168.206.155@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1781307348.492471:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2d824fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911296:192.168.206.155@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1781307348.492496:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911360:192.168.206.155@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1781307348.492515:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaa13211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911424:192.168.206.155@tcp:101:ldlm_lock_repla.0 00000100:00100000:2.0:1781307348.492533:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000220dc3f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911488:192.168.206.155@tcp:101:ldlm_lock_repla.0 10000000:01000000:1.0:1781307348.971320:0:130019:0:(mgc_request.c:611:do_requeue()) updating log lustre-cliir 10000000:01000000:1.0:1781307348.971327:0:130019:0:(mgc_request.c:2066:mgc_process_log()) Process log lustre-cliir-ffff959d07a83000 from 41 10000000:01000000:1.0:1781307348.971333:0:130019:0:(mgc_request.c:1104:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:1.0:1781307348.971400:0:130019:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.155@tcp lock: 00000000354d84b3/0x18761f4d8c4ffa7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307348.971412:0:130019:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.155@tcp lock: 00000000354d84b3/0x18761f4d8c4ffa7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307348.971421:0:130019:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.155@tcp lock: 00000000354d84b3/0x18761f4d8c4ffa7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781307348.971461:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ebf7cd9d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456911552:192.168.206.155@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1781307348.971543:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 00000000372dcf15 going to sleep for 6 seconds 00000100:00100000:3.0:1781307348.995537:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ebf7cd9d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456911552:192.168.206.155@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1781307348.995566:0:130019:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.155@tcp lock: 00000000354d84b3/0x18761f4d8c4ffa7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e564b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1781307348.995581:0:130019:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.155@tcp lock: 00000000354d84b3/0x18761f4d8c4ffa7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe42db145352e564b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1781307348.995651:0:130019:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000027a38942 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456911616:192.168.206.155@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1781307348.995717:0:130019:0:(client.c:2500:ptlrpc_set_wait()) set 0000000009d6ba04 going to sleep for 6 seconds 00000100:00100000:1.0:1781307349.006855:0:130019:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000027a38942 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c2ecee20-3525-4370-afdc-78c8998ef134:130019:1867826456911616:192.168.206.155@tcp:256:ll_cfg_requeue.0 00000020:00000080:1.0:1781307349.006897:0:130019:0:(obd_config.c:1384:class_process_config()) processing cmd: cf00f 10000000:01000000:1.0:1781307349.007090:0:130019:0:(mgc_request.c:2138:mgc_process_log()) MGC192.168.206.155@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:1.0:1781307349.007098:0:130019:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.155@tcp lock: 00000000354d84b3/0x18761f4d8c4ffa7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e564b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307349.007109:0:130019:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.155@tcp lock: 00000000354d84b3/0x18761f4d8c4ffa7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe42db145352e564b expref: -99 pid: 130019 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307349.412380:0:147844:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307350.435558:0:147842:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307351.460328:0:144655:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307352.483509:0:130015:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1781307352.974550:0:2271:0:(ldlm_request.c:2489:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000009781c98b/0x18761f4d8c4ff9f6 lrc: 2/0,0 mode: CW/CW res: [0x200002b13:0x323c:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e566e expref: -99 pid: 224966 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1781307352.974577:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911232:192.168.206.155@tcp:101:ldlm_lock_repla.0 00010000:00010000:0.0:1781307352.974590:0:2271:0:(ldlm_request.c:2489:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000fbab4f27/0x18761f4d8c4ff9e1 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323b:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e5675 expref: -99 pid: 224394 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1781307352.974598:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2d824fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911296:192.168.206.155@tcp:101:ldlm_lock_repla.0 00010000:00010000:0.0:1781307352.974607:0:2271:0:(ldlm_request.c:2489:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000104b03af/0x18761f4d8c4ff9b7 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323a:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e567c expref: -99 pid: 224393 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1781307352.974614:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911360:192.168.206.155@tcp:101:ldlm_lock_repla.0 00010000:00010000:0.0:1781307352.974623:0:2271:0:(ldlm_request.c:2489:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000005713ce0a/0x18761f4d8c4ff614 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x3234:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e5683 expref: -99 pid: 217899 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1781307352.974629:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaa13211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911424:192.168.206.155@tcp:101:ldlm_lock_repla.0 00010000:00010000:0.0:1781307352.974638:0:2271:0:(ldlm_request.c:2489:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000651dd250/0x18761f4d8c4ff5f8 lrc: 2/0,0 mode: CW/CW res: [0x200002b13:0x3232:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e568a expref: -99 pid: 217308 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1781307352.974644:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1781307352.974670:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000220dc3f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911488:192.168.206.155@tcp:101:ldlm_lock_repla.0 00000100:00100000:0.0:1781307352.974729:0:2271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000906a1116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911680:192.168.206.155@tcp:400:ptlrpcd_rcv.0 00000100:00080000:0.0:1781307352.990912:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1781307352.990929:0:2271:0:(client.c:2948:ptlrpc_resend_req()) @@@ going to resend req@00000000906a1116 x1867826456911680/t0(0) o400->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307383 ref 1 fl Interpret:RQU/c0/0 rc 0/0 job:'ptlrpcd_rcv.0' 00000100:00080000:0.0:1781307352.990948:0:2271:0:(client.c:2957:ptlrpc_resend_req()) @@@ it has reply, so skip it req@00000000906a1116 x1867826456911680/t0(0) o400->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307383 ref 1 fl Interpret:RQU/c0/0 rc 0/0 job:'ptlrpcd_rcv.0' 00000100:00080000:0.0:1781307352.990954:0:2271:0:(import.c:86:import_set_state_nolock()) 00000000d816ce5c lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1781307352.990970:0:2271:0:(import.c:1642:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-mdc-ffff959d07a83000: Connection restored to 192.168.206.155@tcp (at 192.168.206.155@tcp) 00000100:00100000:0.0:1781307352.990975:0:2271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000906a1116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2271:1867826456911680:192.168.206.155@tcp:400:ptlrpcd_rcv.0 00000100:00080000:0.0:1781307353.444282:0:219767:0:(pinger.c:251:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: level IDLE/11 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1781307353.444288:0:219767:0:(pinger.c:265:ptlrpc_pinger_process_import()) da51bb3e-7e79-4dc0-9fef-ded06b3ae14f->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: IDLE) 00000100:00100000:1.0:1781307353.444406:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000906a1116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456911744:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781307353.444509:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaa13211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911872:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781307353.444543:0:2272:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1781307353.444550:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000220dc3f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911808:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781307353.444585:0:2272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911936:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781307353.454074:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000220dc3f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911808:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781307353.454093:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000906a1116 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c2ecee20-3525-4370-afdc-78c8998ef134:2272:1867826456911744:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00080000:1.0:1781307353.454104:0:2272:0:(ldlm_request.c:1487:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@00000000aaa13211 x1867826456911872/t0(0) o400->lustre-MDT0001-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 224/224 e 0 to 0 dl 1781307384 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1781307353.454114:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaa13211 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911872:192.168.206.155@tcp:400:kworker/u8:1.0 00000100:00100000:1.0:1781307353.455551:0:2272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c8550649 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:2272:1867826456911936:192.168.206.155@tcp:400:kworker/u8:1.0 00010000:00010000:3.0:1781307353.507577:0:147841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1781307354.062472:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:2.0:1781307354.062500:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1781307354.062556:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.062568:0:227549:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.062586:0:227549:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781307354.062610:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004ca2659 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912000:192.168.206.155@tcp:101:rm.0 00000100:00100000:2.0:1781307354.062691:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f8016905 going to sleep for 30 seconds 00000100:00100000:2.0:1781307354.069292:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004ca2659 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912000:192.168.206.155@tcp:101:rm.0 00010000:00010000:2.0:1781307354.069317:0:227549:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069328:0:227549:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069339:0:227549:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069350:0:227549:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069390:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069399:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069404:0:227549:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1781307354.069414:0:227549:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@0000000004ca2659 x1867826456912000/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 576/688 e 0 to 0 dl 1781307385 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:2.0:1781307354.069440:0:227549:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069452:0:227549:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:2.0:1781307354.069479:0:227549:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 20480 00000080:00010000:2.0:1781307354.069485:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ffa82 00000080:00010000:2.0:1781307354.069490:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:2.0:1781307354.069493:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa82 from it 000000001cdcb990 00010000:00010000:2.0:1781307354.069495:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069501:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1781307354.069524:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:2.0:1781307354.069540:0:227549:0:(namei.c:1111:ll_lookup_nd()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), flags=8 00000080:00200000:2.0:1781307354.069544:0:227549:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), intent=getattr 00000002:00010000:2.0:1781307354.069561:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d818.sanity,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1781307354.069596:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069602:0:227549:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.069610:0:227549:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781307354.069630:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004ca2659 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912064:192.168.206.155@tcp:101:rm.0 00000100:00100000:2.0:1781307354.069705:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f8016905 going to sleep for 30 seconds 00000100:00100000:2.0:1781307354.074815:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004ca2659 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912064:192.168.206.155@tcp:101:rm.0 00010000:00010000:2.0:1781307354.074842:0:227549:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074859:0:227549:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074863:0:227549:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074871:0:227549:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074877:0:227549:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074895:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074903:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074909:0:227549:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1781307354.074919:0:227549:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@0000000004ca2659 x1867826456912064/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/688 e 0 to 0 dl 1781307385 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:2.0:1781307354.074931:0:227549:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.074959:0:227549:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 4 res 8589945619/12862 (0 0) 00000080:00200000:2.0:1781307354.074990:0:227549:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323e:0x0], updating i_size 4096 00000080:00200000:2.0:1781307354.074993:0:227549:0:(namei.c:157:ll_iget()) got inode: [0x200002b13:0x323e:0x0](00000000b48957bd): rc = 0 00000080:00010000:2.0:1781307354.075000:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) for lock 0x18761f4d8c4ffa89 00000080:00010000:2.0:1781307354.075011:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) 00000080:00010000:2.0:1781307354.075015:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa89 from it 00000000b9f3c95c 00010000:00010000:2.0:1781307354.075017:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.075025:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1781307354.075067:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd),name=d818.sanity 00000002:00010000:2.0:1781307354.075087:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1781307354.075094:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.075102:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1781307354.075109:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) 00000080:00010000:2.0:1781307354.075111:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) for lock 0x18761f4d8c4ffa89 00000080:00010000:2.0:1781307354.075115:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa89 from it 000000009a10afe5 00010000:00010000:2.0:1781307354.075117:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.075122:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1781307354.075187:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:2.0:1781307354.075194:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1781307354.075305:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.075314:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1781307354.075322:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:2.0:1781307354.075324:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ffa82 00000080:00010000:2.0:1781307354.075327:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa82 from it 000000005ac9c017 00010000:00010000:2.0:1781307354.075329:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.075335:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1781307354.075342:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:2.0:1781307354.075349:0:227549:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d818.sanity, flags=266 00000080:00200000:2.0:1781307354.075353:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 44 00000080:00200000:2.0:1781307354.075412:0:227549:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), flags 704400 00000002:00010000:2.0:1781307354.075427:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 0240704401 00010000:00010000:2.0:1781307354.075471:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.075478:0:227549:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1781307354.075500:0:227549:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1781307354.075506:0:227549:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000004ca2659 x1867826456912192/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1781307354.075513:0:227549:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781307354.075531:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004ca2659 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912192:192.168.206.155@tcp:101:rm.0 00000100:00100000:2.0:1781307354.076006:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f8016905 going to sleep for 30 seconds 00000100:00100000:2.0:1781307354.077888:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004ca2659 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912192:192.168.206.155@tcp:101:rm.0 00010000:00010000:2.0:1781307354.078025:0:227549:0:(ldlm_request.c:641:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078040:0:227549:0:(ldlm_request.c:562:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078047:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078053:0:227549:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078060:0:227549:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078066:0:227549:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000049164247 already unused, calling callback (00000000430e9631) 00010000:00010000:2.0:1781307354.078069:0:227549:0:(ldlm_request.c:1546:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078091:0:227549:0:(ldlm_request.c:1556:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078098:0:227549:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078105:0:227549:0:(ldlm_request.c:1248:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1781307354.078110:0:227549:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078116:0:227549:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1781307354.078135:0:227549:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@0000000004ca2659 x1867826456912192/t34359738369(34359738369) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'rm.0' 00000002:00100000:2.0:1781307354.078145:0:227549:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000004ca2659 x1867826456912192/t34359738369(34359738369) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'rm.0' 00000080:00200000:2.0:1781307354.078170:0:227549:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323e:0x0], updating i_size 4096 00000002:00100000:2.0:1781307354.078184:0:227549:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000004ca2659 x1867826456912192/t34359738369(34359738369) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 2 fl Complete:RPQU/4/0 rc 301/301 job:'rm.0' 00000080:00200000:2.0:1781307354.078355:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd),name=d818.sanity 00000002:00010000:2.0:1781307354.078657:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1781307354.078670:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078680:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1781307354.078699:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) 00000080:00010000:2.0:1781307354.078702:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) for lock 0x18761f4d8c4ffa89 00000080:00010000:2.0:1781307354.078707:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa89 from it 00000000c7541548 00010000:00010000:2.0:1781307354.078710:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078717:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1781307354.078769:0:227549:0:(dir.c:345:ll_iterate()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd) pos/size0/4096 32bit_api 0 00000002:00010000:2.0:1781307354.078781:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323e:0x0]) in obj [0x200002b13:0x323e:0x0], intent: readdir flags 0 00010000:00010000:2.0:1781307354.078787:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.078793:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781307354.079487:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c291a37 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912256:192.168.206.155@tcp:37:rm.0 00000100:00100000:2.0:1781307354.079571:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f8016905 going to sleep for 6 seconds 00000100:00100000:1.0:1781307354.089046:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c291a37 pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912256:192.168.206.155@tcp:37:rm.0 00010000:00010000:1.0:1781307354.089833:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.090020:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307354.090085:0:227549:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd) 00000002:00100000:1.0:1781307354.090130:0:227549:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@0000000004ca2659 x1867826456912192/t34359738369(34359738369) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 1 fl Complete:RPQU/4/ffffffff rc 301/-1 job:'rm.0' 00000020:00100000:1.0:1781307354.090158:0:227549:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1781307354.090162:0:227549:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000085fbdb3f x1867826456912384/t0(0) o35->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1781307354.090181:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085fbdb3f pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912384:192.168.206.155@tcp:35:rm.0 00000100:00100000:1.0:1781307354.090326:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bbf6fbec going to sleep for 6 seconds 00000100:00100000:1.0:1781307354.092612:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085fbdb3f pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912384:192.168.206.155@tcp:35:rm.0 00000002:00100000:1.0:1781307354.092644:0:227549:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@0000000004ca2659 x1867826456912192/t34359738369(34359738369) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 1 fl Complete:RQU/4/ffffffff rc 301/-1 job:'rm.0' 00000080:00200000:1.0:1781307354.093097:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:1.0:1781307354.093116:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1781307354.093133:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.093144:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1781307354.093169:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:1.0:1781307354.093172:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ffa82 00000080:00010000:1.0:1781307354.093178:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa82 from it 000000005ac9c017 00010000:00010000:1.0:1781307354.093181:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.093188:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307354.093215:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:1.0:1781307354.093222:0:227549:0:(dcache.c:309:ll_revalidate_dentry()) VFS Op:name=d818.sanity, flags=266 00000080:00200000:1.0:1781307354.093227:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 44 00000080:00200000:1.0:1781307354.093235:0:227549:0:(file.c:837:ll_file_open()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), flags 704400 00000002:00010000:1.0:1781307354.093250:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323e:0x0]) in obj [0x200000007:0x1:0x0], intent: open flags 04240704401 00010000:00010000:1.0:1781307354.093298:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.093305:0:227549:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1781307354.093315:0:227549:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1781307354.093321:0:227549:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000085fbdb3f x1867826456912512/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/131800 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1781307354.093329:0:227549:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1781307354.093348:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085fbdb3f pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912512:192.168.206.155@tcp:101:rm.0 00000100:00100000:1.0:1781307354.093614:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bbf6fbec going to sleep for 30 seconds 00000100:00100000:1.0:1781307354.096060:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085fbdb3f pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912512:192.168.206.155@tcp:101:rm.0 00010000:00010000:1.0:1781307354.096094:0:227549:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.096103:0:227549:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.096112:0:227549:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 4/1,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.096121:0:227549:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 4/1,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1781307354.096133:0:227549:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=200002b, status=0 req@0000000085fbdb3f x1867826456912512/t34359738371(34359738371) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'rm.0' 00000002:00100000:1.0:1781307354.096143:0:227549:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000085fbdb3f x1867826456912512/t34359738371(34359738371) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'rm.0' 00000002:00010000:1.0:1781307354.096152:0:227549:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.096161:0:227549:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 16 res 8589945619/12862 (0 0) 00000080:00200000:1.0:1781307354.096180:0:227549:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323e:0x0], updating i_size 4096 00000080:00010000:1.0:1781307354.096185:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) for lock 0x18761f4d8c4ffa97 00000080:00010000:1.0:1781307354.096191:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa97 from it 000000006dd5d362 00010000:00010000:1.0:1781307354.096194:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 3/1,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.096231:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1781307354.096256:0:227549:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@0000000085fbdb3f x1867826456912512/t34359738371(34359738371) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'rm.0' 00000080:00200000:1.0:1781307354.096422:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd),name=d818.sanity 00000002:00010000:1.0:1781307354.096437:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323e:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1781307354.096445:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.096453:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1781307354.096461:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) 00000080:00010000:1.0:1781307354.096464:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) for lock 0x18761f4d8c4ffa89 00000080:00010000:1.0:1781307354.096468:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa89 from it 00000000c7541548 00010000:00010000:1.0:1781307354.096469:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.096476:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307354.096501:0:227549:0:(llite_lib.c:2585:ll_statfs()) VFS Op:sb=lustre (00000000f3747a49) 00000080:00000004:1.0:1781307354.096504:0:227549:0:(obd_class.h:1069:obd_statfs()) lustre-clilmv-ffff959d07a83000: age 9293, max_age 9339 00800000:00000004:1.0:1781307354.096513:0:227549:0:(obd_class.h:1069:obd_statfs()) lustre-MDT0000-mdc-ffff959d07a83000: age 9293, max_age 9339 00000100:00100000:1.0:1781307354.096543:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009923ceba pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912576:192.168.206.155@tcp:41:rm.0 00000100:00100000:1.0:1781307354.096608:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c7928d53 going to sleep for 30 seconds 00000100:00100000:1.0:1781307354.102100:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009923ceba pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912576:192.168.206.155@tcp:41:rm.0 00800000:00000004:1.0:1781307354.102131:0:227549:0:(obd_class.h:1093:obd_statfs()) lustre-MDT0000-mdc-ffff959d07a83000: update 00000000c2ef4762 cache blocks 1792658/1916558 objects 515932/526740 00000080:00000004:1.0:1781307354.102138:0:227549:0:(obd_class.h:1093:obd_statfs()) lustre-clilmv-ffff959d07a83000: update 000000008a4a3d44 cache blocks 1792658/1916558 objects 515932/526740 00000080:00000004:1.0:1781307354.102142:0:227549:0:(llite_lib.c:2494:ll_statfs_internal()) MDC blocks 1792658/1916558 objects 515932/526740 00000080:00200000:1.0:1781307354.102175:0:227549:0:(dir.c:345:ll_iterate()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd) pos/size0/4096 32bit_api 0 00000002:00010000:1.0:1781307354.102196:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200002b13:0x323e:0x0]) in obj [0x200002b13:0x323e:0x0], intent: readdir flags 0 00010000:00010000:1.0:1781307354.102225:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.102237:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00200000:1.0:1781307354.102254:0:227549:0:(mdc_request.c:1184:mdc_page_locate()) offset fffffffffffffffe [0x0 0xfffffffffffffffe], hash 0x0 00010000:00010000:1.0:1781307354.102258:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1781307354.102266:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1781307354.102299:0:227549:0:(dir.c:345:ll_iterate()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd) pos/size18446744073709551614/4096 32bit_api 0 00000080:00200000:1.0:1781307354.102321:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 1 00000080:00200000:1.0:1781307354.102336:0:227549:0:(namei.c:1111:ll_lookup_nd()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd), flags=0 00000080:00200000:1.0:1781307354.102341:0:227549:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd), intent=getattr 00000002:00010000:1.0:1781307354.102355:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f818.sanity,[0x0:0x0:0x0]) in obj [0x200002b13:0x323e:0x0], intent: getattr flags 0 00010000:00010000:2.0:1781307354.102571:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.102580:0:227549:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1781307354.102590:0:227549:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 3/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1781307354.102628:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008cb63e9d pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912640:192.168.206.155@tcp:101:rm.0 00000100:00100000:2.0:1781307354.102743:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 0000000036a7ccd3 going to sleep for 30 seconds 00000100:00100000:0.0:1781307354.105468:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008cb63e9d pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912640:192.168.206.155@tcp:101:rm.0 00010000:00010000:0.0:1781307354.105493:0:227549:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 4/1,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105514:0:227549:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105520:0:227549:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105529:0:227549:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105556:0:227549:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105566:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105572:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105578:0:227549:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307354.105588:0:227549:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@000000008cb63e9d x1867826456912640/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/696 e 0 to 0 dl 1781307385 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:0.0:1781307354.105596:0:227549:0:(mdc_locks.c:847:mdc_finish_enqueue()) ### layout lock returned by: getattr, lvb_len: 56 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00010000:0.0:1781307354.105606:0:227549:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307354.105614:0:227549:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 4 res 8589945619/12863 (0 0) 00000080:00200000:0.0:1781307354.105656:0:227549:0:(namei.c:157:ll_iget()) got inode: [0x200002b13:0x323f:0x0](00000000d34dc47e): rc = 0 00000080:00200000:0.0:1781307354.105669:0:227549:0:(file.c:5870:ll_layout_conf()) [0x200002b13:0x323f:0x0]: layout version change: 4294967294 -> 0 00000080:00010000:0.0:1781307354.105675:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323f:0x0](00000000d34dc47e) for lock 0x18761f4d8c4ffa9e 00000080:00010000:0.0:1781307354.105684:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323f:0x0](00000000d34dc47e) 00000080:00010000:0.0:1781307354.105687:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa9e from it 00000000d52d7f1a 00010000:00010000:0.0:1781307354.105690:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307354.105703:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307354.105733:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd), inode mode 41ed mask 3 00000080:00200000:0.0:1781307354.105740:0:227549:0:(namei.c:2020:ll_unlink()) VFS Op:name=f818.sanity, dir=[0x200002b13:0x323e:0x0](00000000b48957bd) 00010000:00010000:0.0:1781307354.105769:0:227549:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105785:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105841:0:227549:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1781307354.105870:0:227549:0:(vvp_object.c:137:vvp_conf_set()) [0x200002b13:0x323f:0x0]: losing layout lock 00010000:00010000:0.0:1781307354.105910:0:227549:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 1/0,0 mode: --/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307354.105917:0:227549:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 1/0,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.105923:0:227549:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 2 locks packed 00010000:00010000:0.0:1781307354.105925:0:227549:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000049164247/0x18761f4d8c4ffa9e lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xe42db145352e582e expref: -99 pid: 227549 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1781307354.105938:0:227549:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000a41e7e62/0x18761f4d8c4ffa89 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e57ef expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1781307354.105951:0:227549:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1781307354.105961:0:227549:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d2d824fc x1867826456912768/t0(0) o36->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1781307354.105979:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d2d824fc pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912768:192.168.206.155@tcp:36:rm.0 00000100:00100000:0.0:1781307354.106212:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 0000000058348a72 going to sleep for 30 seconds 00000100:00100000:0.0:1781307354.111159:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d2d824fc pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912768:192.168.206.155@tcp:36:rm.0 00000080:00200000:0.0:1781307354.111223:0:227549:0:(vvp_io.c:1820:vvp_io_init()) [0x200002b13:0x323f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:0.0:1781307354.111235:0:227549:0:(lov_io.c:825:lov_io_iter_init()) component[0] flags 0x10 00000080:00200000:0.0:1781307354.111264:0:227549:0:(vvp_io.c:313:vvp_io_fini()) [0x200002b13:0x323f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0 00000080:00200000:0.0:1781307354.111270:0:227549:0:(llite_lib.c:1843:ll_clear_inode()) VFS Op:inode=[0x200002b13:0x323f:0x0](00000000d34dc47e) 00000080:00200000:0.0:1781307354.111347:0:227549:0:(file.c:410:ll_file_release()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd) 00010000:00010000:0.0:1781307354.111399:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307354.111440:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:0.0:1781307354.111453:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1781307354.111461:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.111468:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1781307354.111476:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:0.0:1781307354.111479:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ffa82 00000080:00010000:0.0:1781307354.111486:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa82 from it 000000001f4af559 00010000:00010000:0.0:1781307354.111488:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.111495:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307354.111523:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 1 00000080:00200000:0.0:1781307354.111536:0:227549:0:(namei.c:1111:ll_lookup_nd()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), flags=0 00000080:00200000:0.0:1781307354.111540:0:227549:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4), intent=getattr 00000002:00010000:0.0:1781307354.111550:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d818.sanity,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1781307354.111587:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.111594:0:227549:0:(ldlm_request.c:1026:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.111602:0:227549:0:(ldlm_request.c:1114:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1781307354.111620:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912832:192.168.206.155@tcp:101:rm.0 00000100:00100000:0.0:1781307354.111670:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 0000000058348a72 going to sleep for 30 seconds 00000100:00100000:0.0:1781307354.120585:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912832:192.168.206.155@tcp:101:rm.0 00010000:00010000:0.0:1781307354.120613:0:227549:0:(ldlm_request.c:714:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120633:0:227549:0:(ldlm_request.c:729:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120641:0:227549:0:(ldlm_request.c:742:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 4/1,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120652:0:227549:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120695:0:227549:0:(ldlm_request.c:796:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120707:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120714:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 5/2,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120720:0:227549:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 4/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307354.120730:0:227549:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@0000000064f5f89e x1867826456912832/t0(0) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 584/688 e 0 to 0 dl 1781307385 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'rm.0' 00000002:00010000:0.0:1781307354.120742:0:227549:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120751:0:227549:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns 000000004bf19d2a type 13 mode 4 res 8589945619/12862 (0 0) 00000080:00200000:0.0:1781307354.120790:0:227549:0:(llite_lib.c:2760:ll_update_inode()) inode=[0x200002b13:0x323e:0x0], updating i_size 4096 00000080:00200000:0.0:1781307354.120793:0:227549:0:(namei.c:157:ll_iget()) got inode: [0x200002b13:0x323e:0x0](00000000b48957bd): rc = 0 00000080:00010000:0.0:1781307354.120800:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) for lock 0x18761f4d8c4ffaa5 00000080:00010000:0.0:1781307354.120810:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200002b13:0x323e:0x0](00000000b48957bd) 00000080:00010000:0.0:1781307354.120814:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffaa5 from it 00000000f099eaf8 00010000:00010000:0.0:1781307354.120816:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 3/1,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120823:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307354.120857:0:227549:0:(file.c:5227:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4),name=/ 00000002:00010000:0.0:1781307354.120872:0:227549:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1781307354.120879:0:227549:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120887:0:227549:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1781307354.120894:0:227549:0:(dcache.c:293:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) 00000080:00010000:0.0:1781307354.120896:0:227549:0:(llite_internal.h:1723:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](0000000040c629a4) for lock 0x18761f4d8c4ffa82 00000080:00010000:0.0:1781307354.120900:0:227549:0:(dcache.c:193:ll_intent_drop_lock()) releasing lock with cookie 0x18761f4d8c4ffa82 from it 00000000074289e7 00010000:00010000:0.0:1781307354.120902:0:227549:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120908:0:227549:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1781307354.120916:0:227549:0:(file.c:5661:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](0000000040c629a4), inode mode 41ff mask 3 00000080:00200000:0.0:1781307354.120922:0:227549:0:(namei.c:1931:ll_rmdir()) VFS Op:name=d818.sanity, dir=[0x200000007:0x1:0x0](0000000040c629a4) 00010000:00010000:0.0:1781307354.120942:0:227549:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120972:0:227549:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 2/0,0 mode: PR/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.120987:0:227549:0:(ldlm_request.c:1232:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 2/0,0 mode: CR/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1781307354.121024:0:227549:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@0000000085fbdb3f x1867826456912512/t34359738371(34359738371) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'rm.0' 00000020:00100000:0.0:1781307354.121054:0:227549:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1781307354.121060:0:227549:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000064f5f89e x1867826456912960/t0(0) o35->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:23/10 lens 392/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1781307354.121082:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912960:192.168.206.155@tcp:35:rm.0 00000100:00100000:0.0:1781307354.121162:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 0000000058348a72 going to sleep for 6 seconds 00000100:00100000:0.0:1781307354.131886:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456912960:192.168.206.155@tcp:35:rm.0 00000002:00100000:0.0:1781307354.131925:0:227549:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@0000000085fbdb3f x1867826456912512/t34359738371(34359738371) o101->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 648/600 e 0 to 0 dl 1781307385 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'rm.0' 00010000:00010000:0.0:1781307354.132009:0:227549:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 1/0,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.132018:0:227549:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 1/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.132023:0:227549:0:(ldlm_request.c:1279:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.132029:0:227549:0:(ldlm_request.c:1325:ldlm_cancel_pack()) 3 locks packed 00010000:00010000:0.0:1781307354.132030:0:227549:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 000000007d3352e3/0x18761f4d8c4ffaa5 lrc: 0/0,0 mode: --/PR res: [0x200002b13:0x323e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e5866 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.132041:0:227549:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 00000000995fd007/0x18761f4d8c4ffa97 lrc: 0/0,0 mode: --/CR res: [0x200002b13:0x323e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e580b expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1781307354.132072:0:227549:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff959d07a83000 lock: 0000000082371a98/0x18761f4d8c4ffa82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xe42db145352e57d3 expref: -99 pid: 227549 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1781307354.132088:0:227549:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff959d07a83000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:0.0:1781307354.132093:0:227549:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000064f5f89e x1867826456913088/t0(0) o36->lustre-MDT0000-mdc-ffff959d07a83000@192.168.206.155@tcp:12/10 lens 504/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1781307354.132112:0:227549:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456913088:192.168.206.155@tcp:36:rm.0 00000100:00100000:0.0:1781307354.132196:0:227549:0:(client.c:2500:ptlrpc_set_wait()) set 0000000058348a72 going to sleep for 30 seconds 00000100:00100000:0.0:1781307354.149638:0:227549:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064f5f89e pname:cluuid:pid:xid:nid:opc:job rm:da51bb3e-7e79-4dc0-9fef-ded06b3ae14f:227549:1867826456913088:192.168.206.155@tcp:36:rm.0 00000080:00200000:0.0:1781307354.149696:0:227549:0:(llite_lib.c:1843:ll_clear_inode()) VFS Op:inode=[0x200002b13:0x323e:0x0](00000000b48957bd) 00010000:00010000:0.0:1781307354.533869:0:147065:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1781307355.556728:0:130016:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1781307356.475318:0:227691:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1781307356.475325:0:227691:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity test_818: @@@@@@ FAIL: run LFSCK is not suggested 00010000:00010000:3.0:1781307356.579885:0:147064:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1781307357.604421:0:147840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1235 lines, 1235 kept, 0 dropped, 0 bad.