00000080:00200008:3.0F:1715205906.188406:0:6866:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715205906.188417:0:6866:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:3.0:1715205906.188430:0:6866:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205906.188472:0:6866:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188478:0:6866:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188484:0:6866:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6866 initiator: MDT0 00000100:00100000:3.0:1715205906.188498:0:6866:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989ac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715205906.188505:0:6866:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103b100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:6866:1798523511139968:192.168.204.133@tcp:101:bash.0 00010000:00010000:3.0:1715205906.188512:0:6866:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188516:0:6866:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188520:0:6866:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188525:0:6866:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188530:0:6866:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188534:0:6866:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a3db00 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:3.0:1715205906.188536:0:6866:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188540:0:6866:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188549:0:6866:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188553:0:6866:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205906.188556:0:6866:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 6866 initiator: MDT0 00010000:00010000:3.0:1715205906.188560:0:6866:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3db00/0x361984fab9c06f35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 6866 initiator: MDT0 00000080:00020000:3.0:1715205906.188577:0:6866:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715205906.225575:0:21222:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715205906.225583:0:21222:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:3.0:1715205906.225597:0:21222:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205906.225649:0:21222:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225655:0:21222:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225661:0:21222:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00000100:00100000:3.0:1715205906.225674:0:21222:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989aa80 going to sleep for 0 seconds 00000100:00100000:3.0:1715205906.225682:0:21222:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103b100 pname:cluuid:pid:xid:nid:opc:job lsof:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:21222:1798523511140032:192.168.204.133@tcp:101:lsof.0 00010000:00010000:3.0:1715205906.225689:0:21222:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225694:0:21222:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225697:0:21222:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225704:0:21222:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225709:0:21222:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225712:0:21222:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a3d8c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:3.0:1715205906.225715:0:21222:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225719:0:21222:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225724:0:21222:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225728:0:21222:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205906.225730:0:21222:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.225733:0:21222:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3d8c0/0x361984fab9c06f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21222 initiator: MDT0 00000080:00020000:3.0:1715205906.225747:0:21222:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715205906.226170:0:21222:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7780c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715205906.226174:0:21222:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7780c8),name=/ 00000002:00010000:3.0:1715205906.226181:0:21222:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205906.226199:0:21222:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.226203:0:21222:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00010000:00010000:3.0:1715205906.226216:0:21222:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00000100:00100000:3.0:1715205906.226225:0:21222:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013103b100 pname:cluuid:pid:xid:nid:opc:job lsof:d0b65fb1-a2bf-4259-8680-142a231e8789:21222:1798523511140096:192.168.204.133@tcp:101:lsof.0 00000100:00100000:3.0:1715205906.226280:0:21222:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989aa80 going to sleep for 11 seconds 00000100:00100000:0.0F:1715205906.227380:0:21222:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103b100 pname:cluuid:pid:xid:nid:opc:job lsof:d0b65fb1-a2bf-4259-8680-142a231e8789:21222:1798523511140096:192.168.204.133@tcp:101:lsof.0 00010000:00010000:0.0:1715205906.227402:0:21222:0:(ldlm_request.c:726:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227409:0:21222:0:(ldlm_request.c:754:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227417:0:21222:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227425:0:21222:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227432:0:21222:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227436:0:21222:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227440:0:21222:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1715205906.227447:0:21222:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88013103b100 x1798523511140096/t0(0) o101->lustre-MDT0000-mdc-ffff8800a98fe800@192.168.204.133@tcp:12/10 lens 576/688 e 0 to 0 dl 1715205922 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'lsof.0' uid:0 gid:0 00000002:00010000:0.0:1715205906.227457:0:21222:0:(mdc_locks.c:1277:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227466:0:21222:0:(ldlm_lock.c:1559:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b0af3400 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1715205906.227488:0:21222:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 11776 00000080:00010000:0.0:1715205906.227493:0:21222:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7780c8) for lock 0x361984fab9c06f43 00000080:00010000:0.0:1715205906.227502:0:21222:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7780c8) 00000080:00010000:0.0:1715205906.227504:0:21222:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06f43 from it ffff8800a9bbfcc8 00010000:00010000:0.0:1715205906.227506:0:21222:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.227511:0:21222:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fe800 lock: ffff8800b0a3d680/0x361984fab9c06f43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cb93 expref: -99 pid: 21222 timeout: 0 lvb_type: 0 00000080:00200008:0.0:1715205906.227779:0:21222:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205906.227784:0:21222:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205906.227795:0:21222:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205906.227841:0:21222:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227845:0:21222:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227849:0:21222:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00000100:00100000:0.0:1715205906.227859:0:21222:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b080780 going to sleep for 0 seconds 00000100:00100000:0.0:1715205906.227862:0:21222:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33b80 pname:cluuid:pid:xid:nid:opc:job lsof:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:21222:1798523511140160:192.168.204.133@tcp:101:lsof.0 00010000:00010000:0.0:1715205906.227866:0:21222:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227868:0:21222:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227871:0:21222:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227873:0:21222:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227879:0:21222:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227882:0:21222:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa82f40 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205906.227884:0:21222:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227887:0:21222:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227890:0:21222:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227892:0:21222:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205906.227894:0:21222:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21222 initiator: MDT0 00010000:00010000:0.0:1715205906.227897:0:21222:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82f40/0x361984fab9c06f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21222 initiator: MDT0 00000080:00020000:0.0:1715205906.227908:0:21222:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715205906.232167:0:21223:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205906.232174:0:21223:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205906.232185:0:21223:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205906.232218:0:21223:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232222:0:21223:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232227:0:21223:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21223 initiator: MDT0 00000100:00100000:0.0:1715205906.232241:0:21223:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b080780 going to sleep for 0 seconds 00000100:00100000:0.0:1715205906.232246:0:21223:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33b80 pname:cluuid:pid:xid:nid:opc:job umount:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:21223:1798523511140224:192.168.204.133@tcp:101:umount.0 00010000:00010000:0.0:1715205906.232252:0:21223:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232255:0:21223:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232258:0:21223:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232261:0:21223:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232263:0:21223:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232266:0:21223:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa82d00 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205906.232268:0:21223:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232271:0:21223:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232273:0:21223:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232275:0:21223:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205906.232277:0:21223:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21223 initiator: MDT0 00010000:00010000:0.0:1715205906.232280:0:21223:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa82d00/0x361984fab9c06f51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21223 initiator: MDT0 00000080:00020000:0.0:1715205906.232294:0:21223:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205906.241350:0:21223:0:(llite_lib.c:1925:ll_clear_inode()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8) 00000080:00200000:0.0:1715205906.241380:0:21223:0:(llite_lib.c:1551:ll_put_super()) VFS Op: cfg_instance lustre-client-ffff880136899800 (sb ffff880136899800) 00010000:00010000:0.0:1715205906.241405:0:21223:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241413:0:21223:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241419:0:21223:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241424:0:21223:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241446:0:21223:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1715205906.241451:0:21223:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241455:0:21223:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241460:0:21223:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241464:0:21223:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241483:0:21223:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0F:1715205906.241486:0:4787:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715205906.241488:0:21223:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241499:0:21223:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241499:0:4787:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241503:0:4787:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a80480 already unused, calling callback (ffffffffa0af4a40) 00010000:00010000:0.0:1715205906.241504:0:21223:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205906.241506:0:4787:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241508:0:21223:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241510:0:4787:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205906.241513:0:4787:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205906.241515:0:4787:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1715205906.241516:0:4787:0:(mgc_request.c:940:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1715205906.241518:0:21223:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1715205906.241522:0:21223:0:(mgc_request.c:150:config_log_put()) dropping config log lustre-client 10000000:01000000:0.0:1715205906.241525:0:21223:0:(mgc_request.c:562:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1715205906.241532:0:16466:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715205906.241535:0:16466:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241540:0:16466:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa80240 already unused, calling callback (ffffffffa0af4a40) 10000000:00010000:0.0:1715205906.241542:0:16466:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241547:0:16466:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715205906.241551:0:16466:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715205906.241556:0:16466:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1715205906.241558:0:16466:0:(mgc_request.c:940:mgc_blocking_ast()) log lustre-cliir: stopping, won't requeue 10000000:01000000:0.0:1715205906.241559:0:16466:0:(mgc_request.c:150:config_log_put()) dropping config log lustre-cliir 00010000:00010000:1.0:1715205906.241560:0:4787:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241563:0:4787:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1715205906.241571:0:16466:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241581:0:4787:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241583:0:16466:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205906.241584:0:4787:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800b0a80480/0x361984fab9c069d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c787 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241589:0:16466:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241591:0:4787:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205906.241592:0:4787:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241593:0:16466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800aaa80240/0x361984fab9c0699a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c74f expref: -99 pid: 4775 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241595:0:4787:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a81f80 already unused, calling callback (ffffffffa0af4a40) 10000000:00010000:1.0:1715205906.241596:0:4787:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205906.241599:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205906.241600:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205906.241601:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205906.241604:0:4787:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205906.241607:0:4787:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205906.241609:0:4787:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1715205906.241610:0:4787:0:(mgc_request.c:940:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1715205906.241611:0:4787:0:(mgc_request.c:150:config_log_put()) dropping config log params 00010000:00010000:1.0:1715205906.241616:0:4787:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241619:0:4787:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205906.241620:0:4787:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241623:0:4787:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.241627:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205906.241628:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205906.241629:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205906.241660:0:1962:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511140288:192.168.204.133@tcp:103:ldlm_bl.0 00000020:00020000:0.0:1715205906.241709:0:21223:0:(lu_object.c:998:lu_site_print()) header@ffff88012f84e258[0x4, 3, [0x200000401:0x3:0x0] hash]{ 00000100:00100000:1.0:1715205906.241723:0:1962:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511140416:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715205906.241737:0:1962:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1715205906.241740:0:1962:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511140352:192.168.204.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715205906.241763:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00020000:0.0:1715205906.245115:0:21223:0:(lu_object.c:998:lu_site_print()) ....lovsub@ffff88012f84e2d8[0] 00000100:00100000:1.0:1715205906.245248:0:1962:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511140352:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715205906.245269:0:1962:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511140288:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715205906.245275:0:1962:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511140416:192.168.204.133@tcp:103:ldlm_bl.0 00000020:00020000:0.0:1715205906.247280:0:21223:0:(lu_object.c:998:lu_site_print()) ....mdc@ffff8800a99ae190id: 0x200000401:3 idx: 0 gen: 0 kms_valid: 1 kms 7168 rc: 0 force_sync: 0 min_xid: 0 size: 7168 mtime: 1715205745 atime: 1715205745 ctime: 1715205745 blocks: 2 00000020:00020000:0.0:1715205906.252944:0:21223:0:(lu_object.c:998:lu_site_print()) } header@ffff88012f84e258 00000020:00040000:0.0:1715205906.255927:0:21223:0:(lu_object.c:1250:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1 00000020:00040000:0.0:1715205906.260271:0:21223:0:(lu_object.c:1250:lu_device_fini()) LBUG Debug log: 186 lines, 186 kept, 0 dropped, 0 bad.