00010000:00010000:3.0F:1715205877.694828:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1715205878.695935:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205879.697896:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715205880.503985:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715205880.503990:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0F:1715205880.503999:0:1965:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511134976:192.168.204.133@tcp:400:kworker.0 00000100:00100000:3.0:1715205880.504015:0:1964:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:b074247a-b4e0-48d1-8030-d4461b52d5ca:1964:1798523511135040:192.168.204.133@tcp:400:kworker.0 00000100:00100000:3.0:1715205880.505285:0:1964:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:b074247a-b4e0-48d1-8030-d4461b52d5ca:1964:1798523511135040:192.168.204.133@tcp:400:kworker.0 00000100:00100000:2.0:1715205880.505285:0:1965:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511134976:192.168.204.133@tcp:400:kworker.0 00010000:00010000:0.0:1715205880.699964:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205881.355750:0:15806:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 18:04:41 (1715205881) 00010000:00010000:3.0:1715205881.701978:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205882.703966:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205883.705978:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205884.707917:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205884.945410:0:16260:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 411b 130b 130c 130d 130e 130f 130g 312 00000001:02000400:1.0F:1715205885.292452:0:16411:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 51b 00000080:00200008:2.0:1715205885.330883:0:15828:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205885.330890:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:2.0:1715205885.330906:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205885.330950:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.330957:0:15828:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.330966:0:15828:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00000100:00100000:2.0:1715205885.330981:0:15828:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3000 going to sleep for 0 seconds 00000100:00100000:2.0:1715205885.330990:0:15828:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865c00 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:15828:1798523511135104:192.168.204.133@tcp:101:bash.0 00010000:00010000:2.0:1715205885.330999:0:15828:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331005:0:15828:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331010:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331015:0:15828:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331034:0:15828:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331039:0:15828:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a81440 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:2.0:1715205885.331047:0:15828:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331052:0:15828:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331058:0:15828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331063:0:15828:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715205885.331067:0:15828:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331072:0:15828:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81440/0x361984fab9c06e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00000080:00020000:2.0:1715205885.331089:0:15828:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715205885.331146:0:15828:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205885.331150:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:2.0:1715205885.331156:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205885.331170:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331175:0:15828:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331180:0:15828:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00000100:00100000:2.0:1715205885.331187:0:15828:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3000 going to sleep for 0 seconds 00000100:00100000:2.0:1715205885.331191:0:15828:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865c00 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:15828:1798523511135168:192.168.204.133@tcp:101:bash.0 00010000:00010000:2.0:1715205885.331196:0:15828:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331207:0:15828:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331212:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331216:0:15828:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331221:0:15828:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331224:0:15828:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a81200 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:2.0:1715205885.331226:0:15828:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331231:0:15828:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331235:0:15828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331239:0:15828:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715205885.331241:0:15828:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.331245:0:15828:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81200/0x361984fab9c06e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00000080:00020000:2.0:1715205885.331256:0:15828:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715205885.331304:0:15828:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7408c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205885.331308:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8),name=/ 00000002:00010000:2.0:1715205885.331320:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205885.331329:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205885.331338:0:15828:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715205885.331345:0:15828:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00010000:2.0:1715205885.331348:0:15828:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) for lock 0x361984fab9c06df3 00000080:00010000:2.0:1715205885.331352:0:15828:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06df3 from it ffff8800a996bcc8 00010000:00010000:2.0:1715205885.331355:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205885.331361:0:15828:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00200008:2.0:1715205885.337117:0:15828:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205885.337125:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:2.0:1715205885.337141:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205885.337184:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337191:0:15828:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337199:0:15828:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00000100:00100000:2.0:1715205885.337212:0:15828:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3000 going to sleep for 0 seconds 00000100:00100000:2.0:1715205885.337221:0:15828:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865c00 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:15828:1798523511135232:192.168.204.133@tcp:101:bash.0 00010000:00010000:2.0:1715205885.337265:0:15828:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337275:0:15828:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337280:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337286:0:15828:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337291:0:15828:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337296:0:15828:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a81680 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:2.0:1715205885.337300:0:15828:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337305:0:15828:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337310:0:15828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337315:0:15828:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715205885.337319:0:15828:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337323:0:15828:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a81680/0x361984fab9c06e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00000080:00020000:2.0:1715205885.337340:0:15828:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715205885.337395:0:15828:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205885.337399:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:2.0:1715205885.337408:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205885.337422:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337427:0:15828:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337433:0:15828:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00000100:00100000:2.0:1715205885.337439:0:15828:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3000 going to sleep for 0 seconds 00000100:00100000:2.0:1715205885.337443:0:15828:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865c00 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:15828:1798523511135296:192.168.204.133@tcp:101:bash.0 00010000:00010000:2.0:1715205885.337448:0:15828:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337453:0:15828:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337457:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337461:0:15828:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337465:0:15828:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337469:0:15828:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a818c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:2.0:1715205885.337471:0:15828:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337475:0:15828:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337487:0:15828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337492:0:15828:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715205885.337494:0:15828:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00010000:00010000:2.0:1715205885.337499:0:15828:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a818c0/0x361984fab9c06e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00000080:00020000:2.0:1715205885.337510:0:15828:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715205885.337570:0:15828:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7408c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205885.337574:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8),name=/ 00000002:00010000:2.0:1715205885.337583:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205885.337590:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205885.337599:0:15828:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715205885.337607:0:15828:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00010000:2.0:1715205885.337610:0:15828:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) for lock 0x361984fab9c06df3 00000080:00010000:2.0:1715205885.337614:0:15828:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06df3 from it ffff8800a996bcc8 00010000:00010000:2.0:1715205885.337616:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205885.337622:0:15828:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715205885.392323:0:16463:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205885.392330:0:16463:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205885.392345:0:16463:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205885.392387:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392395:0:16463:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392402:0:16463:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16463 initiator: MDT0 00000100:00100000:1.0:1715205885.392416:0:16463:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851180 going to sleep for 0 seconds 00000100:00100000:1.0:1715205885.392427:0:16463:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1eed80 pname:cluuid:pid:xid:nid:opc:job lsof:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:16463:1798523511135360:192.168.204.133@tcp:101:lsof.0 00010000:00010000:1.0:1715205885.392434:0:16463:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392440:0:16463:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392445:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392450:0:16463:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392455:0:16463:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392460:0:16463:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a2640 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205885.392463:0:16463:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392475:0:16463:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392481:0:16463:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392486:0:16463:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205885.392489:0:16463:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16463 initiator: MDT0 00010000:00010000:1.0:1715205885.392494:0:16463:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2640/0x361984fab9c06e32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16463 initiator: MDT0 00000080:00020000:1.0:1715205885.392510:0:16463:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715205885.392757:0:16463:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7408c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205885.392761:0:16463:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8),name=/ 00000002:00010000:1.0:1715205885.392768:0:16463:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205885.392776:0:16463:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.392783:0:16463:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715205885.392790:0:16463:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00010000:1.0:1715205885.392793:0:16463:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) for lock 0x361984fab9c06df3 00000080:00010000:1.0:1715205885.392797:0:16463:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06df3 from it ffff8800a9953cc8 00010000:00010000:1.0:1715205885.392799:0:16463:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.392804:0:16463:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715205885.481836:0:16464:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7408c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205885.481844:0:16464:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8),name=/ 00000002:00010000:1.0:1715205885.481860:0:16464:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205885.481873:0:16464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.481884:0:16464:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715205885.481894:0:16464:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00010000:1.0:1715205885.481896:0:16464:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012e7408c8) for lock 0x361984fab9c06df3 00000080:00010000:1.0:1715205885.481901:0:16464:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x361984fab9c06df3 from it ffff88012f84bcc8 00010000:00010000:1.0:1715205885.481904:0:16464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.481911:0:16464:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715205885.492272:0:5:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1715205885.492286:0:5:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1715205885.492299:0:5:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1715205885.492312:0:5:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1715205885.492409:0:5:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1715205885.492413:0:5:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1715205885.492416:0:5:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:3.0:1715205885.492431:0:5:0:(osc_cache.c:1842:try_to_add_extent_for_io()) ### extent: ffff8800aaab90b8 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000008:00010000:3.0:1715205885.492444:0:5:0:(osc_cache.c:1089:osc_extent_make_ready()) ### extent: ffff8800aaab90b8 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715205885.492477:0:5:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000008:00100000:3.0:1715205885.492537:0:5:0:(osc_request.c:1963:osc_brw_prep_request()) brw rpc ffff880131038380 - object 0x200000402:1 offset 0<>1000 00000100:00100000:3.0:1715205885.492579:0:1964:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715205885.492599:0:1964:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:b074247a-b4e0-48d1-8030-d4461b52d5ca:1964:1798523511135424:192.168.204.133@tcp:4:md5sum.0 00000008:00010000:3.0:1715205885.494758:0:1964:0:(osc_cache.c:845:osc_extent_finish()) ### extent: ffff8800aaab90b8 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000008:00010000:3.0:1715205885.494789:0:1964:0:(osc_cache.c:504:__osc_extent_remove()) ### extent: ffff8800aaab90b8 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1715205885.494801:0:1964:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:b074247a-b4e0-48d1-8030-d4461b52d5ca:1964:1798523511135424:192.168.204.133@tcp:4:md5sum.0 00000080:00200000:0.0:1715205885.494843:0:5:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1715205885.494921:0:16464:0:(llite_lib.c:1925:ll_clear_inode()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7408c8) 00000080:00200000:2.0:1715205885.494949:0:16464:0:(vvp_io.c:1871:vvp_io_init()) [0x200000401:0x3:0x0] ignore/verify layout 1/0, layout version 2 restore needed 0 00020000:00200000:2.0:1715205885.494957:0:16464:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1715205885.494962:0:16464:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1715205885.494969:0:16464:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1715205885.494972:0:16464:0:(llite_lib.c:1925:ll_clear_inode()) VFS Op:inode=[0x200000401:0x3:0x0](ffff8800b23a18c8) 00000080:00200000:2.0:1715205885.495056:0:16464:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1715205885.495060:0:16464:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1715205885.495062:0:16464:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1715205885.495066:0:16464:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1715205885.495087:0:16464:0:(llite_lib.c:1925:ll_clear_inode()) VFS Op:inode=[0x200000402:0x1:0x0](ffff8800b23a20c8) 00000002:00100000:2.0:1715205885.495108:0:16464:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800adc33100 x1798523511134592/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205888 ref 1 fl Complete:RPQU/204/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 00000020:00100000:2.0:1715205885.495125:0:16464:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a98fb800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1715205885.495129:0:16464:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800aa865c00 x1798523511135552/t0(0) o35->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:23/10 lens 392/712 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715205885.495145:0:16464:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865c00 pname:cluuid:pid:xid:nid:opc:job umount:b074247a-b4e0-48d1-8030-d4461b52d5ca:16464:1798523511135552:192.168.204.133@tcp:35:umount.0 00000100:00100000:2.0:1715205885.495185:0:16464:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3180 going to sleep for 11 seconds 00000100:00100000:0.0:1715205885.496307:0:16464:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865c00 pname:cluuid:pid:xid:nid:opc:job umount:b074247a-b4e0-48d1-8030-d4461b52d5ca:16464:1798523511135552:192.168.204.133@tcp:35:umount.0 00000002:00100000:0.0:1715205885.496322:0:16464:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800adc33100 x1798523511134592/t4294967317(4294967317) o101->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205888 ref 1 fl Complete:RQU/204/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 00000002:00010000:0.0:1715205885.496346:0:16464:0:(mdc_dev.c:1493:mdc_object_ast_clear()) ### update lock size 0 blocks 2 [cma]time: 1715205872 1715205872 1715205872 by oinfo size 1000 blocks 2 [cma]time 1715205872 1715205872 1715205872 ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 1/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00000080:00200000:0.0:1715205885.496369:0:16464:0:(llite_lib.c:1551:ll_put_super()) VFS Op: cfg_instance lustre-client-ffff8800a98fb800 (sb ffff8800a98fb800) 00010000:00010000:0.0:1715205885.496384:0:16464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496389:0:16464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496395:0:16464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496399:0:16464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496418:0:16464:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1715205885.496422:0:16464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496427:0:16464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496440:0:16464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496442:0:4787:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715205885.496444:0:16464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496448:0:4787:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496454:0:4787:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa81680 already unused, calling callback (ffffffffa0af4a40) 10000000:00010000:3.0:1715205885.496457:0:4787:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496463:0:16464:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1715205885.496464:0:4787:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715205885.496469:0:4787:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496469:0:16464:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715205885.496473:0:4787:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1715205885.496474:0:16464:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715205885.496475:0:4787:0:(mgc_request.c:940:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1715205885.496478:0:16464:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496482:0:16464:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.496488:0:16464:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1715205885.496491:0:16464:0:(mgc_request.c:150:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1715205885.496493:0:4787:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715205885.496495:0:16464:0:(mgc_request.c:562:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1715205885.496498:0:4787:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205885.496504:0:5285:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715205885.496516:0:4787:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496530:0:4787:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c069e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c82f expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205885.496533:0:1965:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1715205885.496541:0:4787:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205885.496543:0:4787:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205885.496543:0:1965:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511135616:192.168.204.133@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715205885.496548:0:4787:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a80900 already unused, calling callback (ffffffffa0af4a40) 10000000:00010000:3.0:1715205885.496550:0:4787:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496554:0:4787:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715205885.496558:0:4787:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715205885.496562:0:4787:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1715205885.496563:0:4787:0:(mgc_request.c:940:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1715205885.496565:0:4787:0:(mgc_request.c:150:config_log_put()) dropping config log params 00010000:00010000:3.0:1715205885.496576:0:4787:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496579:0:4787:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715205885.496587:0:4787:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496592:0:4787:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800b0a80900/0x361984fab9c06a96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c9d3 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.496592:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205885.496597:0:5285:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205885.496598:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205885.496602:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205885.496602:0:5285:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa818c0 already unused, calling callback (ffffffffa0af4a40) 00010000:00010000:3.0:1715205885.496604:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1715205885.496605:0:5285:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.496610:0:5285:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205885.496613:0:1965:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511135680:192.168.204.133@tcp:103:ldlm_bl.0 10000000:00010000:1.0:1715205885.496619:0:5285:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205885.496623:0:5285:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1715205885.496625:0:5285:0:(mgc_request.c:940:mgc_blocking_ast()) log lustre-cliir: stopping, won't requeue 10000000:01000000:1.0:1715205885.496626:0:5285:0:(mgc_request.c:150:config_log_put()) dropping config log lustre-cliir 00010000:00010000:1.0:1715205885.496639:0:5285:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.496643:0:5285:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00020000:01000000:0.0:1715205885.496650:0:16464:0:(lov_obd.c:637:lov_del_target()) uuid: lustre-OST0000_UUID idx: 0 gen: 1 exp: ffff8800b43c5800 active: 1 00020000:01000000:0.0:1715205885.496652:0:16464:0:(lov_obd.c:637:lov_del_target()) uuid: lustre-OST0001_UUID idx: 1 gen: 1 exp: ffff8800b43c2000 active: 1 00010000:00010000:1.0:1715205885.496660:0:5285:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205885.496665:0:5285:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa4db7398a345c836 expref: -99 pid: 7346 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205885.496666:0:1963:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715205885.496672:0:1963:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511135744:192.168.204.133@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715205885.496673:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205885.496674:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205885.496675:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205885.496682:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205885.496683:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00020000:01000000:0.0:1715205885.496698:0:16464:0:(lov_obd.c:84:lov_tgts_putref()) destroying 2 lov targets 00020000:01000000:0.0:1715205885.496702:0:16464:0:(lov_obd.c:659:__lov_del_obd()) Removing tgt lustre-OST0001_UUID : lustre-OST0001-osc-ffff8800a98fb800 00020000:01000000:0.0:1715205885.496703:0:16464:0:(lov_obd.c:268:lov_disconnect_obd()) lustre-clilov-ffff8800a98fb800: disconnecting target lustre-OST0001-osc-ffff8800a98fb800 00000100:00080000:0.0:1715205885.496718:0:16464:0:(pinger.c:420:ptlrpc_pinger_del_import()) removing pingable import b074247a-b4e0-48d1-8030-d4461b52d5ca->lustre-OST0001_UUID 00000100:00080000:0.0:1715205885.496792:0:16464:0:(import.c:86:import_set_state_nolock()) ffff8800b0bc5800 lustre-OST0001_UUID: changing import state from IDLE to CLOSED 00000100:00080000:0.0:1715205885.496797:0:16464:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1715205885.496799:0:16464:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8800a98fb800: committing for last_committed 0 gen 2 00000100:00100000:0.0:1715205885.496801:0:16464:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1715205885.496925:0:16464:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x361984fab9c06a3b 00000020:00000080:0.0:1715205885.496934:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b43c2000/LOV_OSC_UUID 00000020:00000080:2.0:1715205885.496949:0:5:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b43c2000/LOV_OSC_UUID for lustre-OST0001-osc-ffff8800a98fb800 00000020:01000000:0.0:1715205885.496958:0:16464:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-ffff8800a98fb800 (flags='') 00000020:00000080:0.0:1715205885.496961:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1715205885.496967:0:16464:0:(obd_config.c:900:class_cleanup()) lustre-OST0001-osc-ffff8800a98fb800: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1715205885.496970:0:16464:0:(genops.c:1485:class_disconnect_exports()) OBD device 10 (ffff88012e24d540) has no exports 00000008:01000000:0.0:1715205885.496996:0:16464:0:(obd_class.h:698:obd_cleanup_client_import()) lustre-OST0001-osc-ffff8800a98fb800: client import never connected 00000100:00080000:0.0:1715205885.496998:0:16464:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1715205885.497000:0:16464:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8800a98fb800: committing for last_committed 0 gen 3 00000100:00100000:0.0:1715205885.497001:0:16464:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1715205885.497162:0:5:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff8800b0bc5800 for lustre-OST0001-osc-ffff8800a98fb800 00000020:00000080:0.0:1715205885.497244:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1715205885.497249:0:16464:0:(obd_config.c:828:class_detach()) detach on obd lustre-OST0001-osc-ffff8800a98fb800 (uuid b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:00000080:0.0:1715205885.497251:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b0bc7800/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:00000080:0.0:1715205885.497252:0:16464:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b0bc7800/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-OST0001-osc-ffff8800a98fb800 00000020:01000000:0.0:1715205885.497255:0:16464:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-ffff8800a98fb800 (b074247a-b4e0-48d1-8030-d4461b52d5ca) 00020000:01000000:0.0:1715205885.497332:0:16464:0:(lov_obd.c:659:__lov_del_obd()) Removing tgt lustre-OST0000_UUID : lustre-OST0000-osc-ffff8800a98fb800 00020000:01000000:0.0:1715205885.497333:0:16464:0:(lov_obd.c:268:lov_disconnect_obd()) lustre-clilov-ffff8800a98fb800: disconnecting target lustre-OST0000-osc-ffff8800a98fb800 00000100:00080000:0.0:1715205885.497336:0:16464:0:(pinger.c:420:ptlrpc_pinger_del_import()) removing pingable import b074247a-b4e0-48d1-8030-d4461b52d5ca->lustre-OST0000_UUID 00000100:00080000:0.0:1715205885.497476:0:16464:0:(import.c:86:import_set_state_nolock()) ffff8800b0bc2800 lustre-OST0000_UUID: changing import state from IDLE to CLOSED 00000100:00080000:0.0:1715205885.497479:0:16464:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1715205885.497480:0:16464:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8800a98fb800: committing for last_committed 0 gen 2 00000100:00100000:0.0:1715205885.497481:0:16464:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1715205885.497503:0:1965:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511135680:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715205885.497511:0:1965:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1965:1798523511135616:192.168.204.133@tcp:103:ldlm_bl.0 00000020:00000080:0.0:1715205885.497579:0:16464:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x361984fab9c06a34 00000020:00000080:0.0:1715205885.497590:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b43c5800/LOV_OSC_UUID 00000020:00000080:2.0:1715205885.497602:0:5:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b43c5800/LOV_OSC_UUID for lustre-OST0000-osc-ffff8800a98fb800 00000100:00100000:0.0:1715205885.497607:0:1963:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511135744:192.168.204.133@tcp:103:ldlm_bl.0 00000020:01000000:0.0:1715205885.497630:0:16464:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-ffff8800a98fb800 (flags='') 00000020:00000080:0.0:1715205885.497632:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1715205885.497636:0:16464:0:(obd_config.c:900:class_cleanup()) lustre-OST0000-osc-ffff8800a98fb800: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1715205885.497638:0:16464:0:(genops.c:1485:class_disconnect_exports()) OBD device 9 (ffff88012e24bff0) has no exports 00000008:01000000:0.0:1715205885.497651:0:16464:0:(obd_class.h:698:obd_cleanup_client_import()) lustre-OST0000-osc-ffff8800a98fb800: client import never connected 00000100:00080000:0.0:1715205885.497653:0:16464:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1715205885.497654:0:16464:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8800a98fb800: committing for last_committed 0 gen 3 00000100:00100000:0.0:1715205885.497657:0:16464:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1715205885.497772:0:5:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff8800b0bc2800 for lustre-OST0000-osc-ffff8800a98fb800 00000020:00000080:0.0:1715205885.497862:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1715205885.497867:0:16464:0:(obd_config.c:828:class_detach()) detach on obd lustre-OST0000-osc-ffff8800a98fb800 (uuid b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:00000080:0.0:1715205885.497870:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b0bc7000/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:00000080:0.0:1715205885.497871:0:16464:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b0bc7000/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-OST0000-osc-ffff8800a98fb800 00000020:01000000:0.0:1715205885.497875:0:16464:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-ffff8800a98fb800 (b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:00000080:0.0:1715205885.497978:0:16464:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x361984fab9c06a2d 00000020:00000080:0.0:1715205885.497982:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b43c6000/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:00000080:2.0:1715205885.498007:0:5:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b43c6000/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-clilov-ffff8800a98fb800 00000100:00080000:0.0:1715205885.498141:0:16464:0:(pinger.c:420:ptlrpc_pinger_del_import()) removing pingable import b074247a-b4e0-48d1-8030-d4461b52d5ca->lustre-MDT0000_UUID 00010000:00010000:0.0:1715205885.498184:0:16464:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205885.498195:0:16464:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205885.498208:0:16464:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205885.498213:0:16464:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205885.498224:0:16464:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 2 locks packed 00000100:00100000:0.0:1715205885.498231:0:16464:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b53c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205885.498235:0:16464:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job umount:b074247a-b4e0-48d1-8030-d4461b52d5ca:16464:1798523511135808:192.168.204.133@tcp:103:umount.0 00010000:00010000:0.0:1715205885.498239:0:16464:0:(ldlm_request.c:1493:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1715205885.498243:0:16464:0:(ldlm_request.c:2272:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1715205885.498245:0:16464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83840/0x361984fab9c06dfa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa4db7398a345cadd expref: -99 pid: 14115 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205885.498253:0:16464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800ac1a18c0/0x361984fab9c06de5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xa4db7398a345caba expref: -99 pid: 14110 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1715205885.498325:0:16464:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.498338:0:16464:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205885.498343:0:16464:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715205885.498347:0:16464:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b53c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205885.498351:0:16464:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job umount:b074247a-b4e0-48d1-8030-d4461b52d5ca:16464:1798523511135872:192.168.204.133@tcp:103:umount.0 00010000:00010000:0.0:1715205885.498354:0:16464:0:(ldlm_request.c:1493:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:0.0:1715205885.498356:0:16464:0:(ldlm_request.c:2272:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:0.0:1715205885.498358:0:16464:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a98fb800 lock: ffff8800aaa83600/0x361984fab9c06df3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xa4db7398a345cacf expref: -99 pid: 14115 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1715205885.499289:0:16464:0:(import.c:86:import_set_state_nolock()) ffff8800b0bc3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1715205885.499298:0:16464:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job umount:b074247a-b4e0-48d1-8030-d4461b52d5ca:16464:1798523511135936:192.168.204.133@tcp:39:umount.0 00000100:00100000:0.0:1715205885.499341:0:16464:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b53c0 going to sleep for 5 seconds 00000100:00100000:0.0:1715205885.500512:0:16464:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job umount:b074247a-b4e0-48d1-8030-d4461b52d5ca:16464:1798523511135936:192.168.204.133@tcp:39:umount.0 00000100:00080000:0.0:1715205885.500519:0:16464:0:(import.c:86:import_set_state_nolock()) ffff8800b0bc3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1715205885.500523:0:16464:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1715205885.500524:0:16464:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a98fb800: committing for last_committed 4294967317 gen 2 00000100:00100000:0.0:1715205885.500528:0:16464:0:(client.c:2994:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880131038380 x1798523511135424/t4294967318(4294967318) o4->lustre-MDT0000-mdc-ffff8800a98fb800@192.168.204.133@tcp:13/10 lens 1488/448 e 0 to 0 dl 1715205901 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 00000100:00100000:0.0:1715205885.500535:0:16464:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1715205885.501742:0:16464:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x361984fab9c06a26 00000020:00000080:0.0:1715205885.501746:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b58cc000/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:00000080:0.0:1715205885.501766:0:16464:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x361984fab9c06a1f 00000020:00000080:0.0:1715205885.501768:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b58cd000/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:01000000:0.0:1715205885.501773:0:16464:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-clilov-ffff8800a98fb800 (flags='') 00000020:00000080:0.0:1715205885.501775:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1715205885.501778:0:16464:0:(obd_config.c:900:class_cleanup()) lustre-clilov-ffff8800a98fb800: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1715205885.501780:0:16464:0:(genops.c:1485:class_disconnect_exports()) OBD device 6 (ffff88012e248000) has no exports 00000020:00000080:2.0:1715205885.501790:0:5:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b58cc000/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-MDT0000-mdc-ffff8800a98fb800 00000020:00000080:0.0:1715205885.501794:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1715205885.501795:0:5:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b58cd000/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-clilmv-ffff8800a98fb800 00000020:00000080:0.0:1715205885.501797:0:16464:0:(obd_config.c:828:class_detach()) detach on obd lustre-clilov-ffff8800a98fb800 (uuid b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:00000080:0.0:1715205885.501798:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b0bc3000/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:00000080:0.0:1715205885.501800:0:16464:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b0bc3000/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-clilov-ffff8800a98fb800 00000020:01000000:0.0:1715205885.501803:0:16464:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-clilov-ffff8800a98fb800 (b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:01000000:0.0:1715205885.501851:0:16464:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-clilmv-ffff8800a98fb800 (flags='') 00000020:00000080:0.0:1715205885.501852:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1715205885.501853:0:16464:0:(obd_config.c:900:class_cleanup()) lustre-clilmv-ffff8800a98fb800: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1715205885.501854:0:16464:0:(genops.c:1485:class_disconnect_exports()) OBD device 7 (ffff88012e249550) has no exports 00000020:00000080:0.0:1715205885.501867:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1715205885.501869:0:16464:0:(obd_config.c:828:class_detach()) detach on obd lustre-clilmv-ffff8800a98fb800 (uuid b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:00000080:0.0:1715205885.501870:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b0bc5000/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:00000080:0.0:1715205885.501874:0:16464:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b0bc5000/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-clilmv-ffff8800a98fb800 00000020:01000000:0.0:1715205885.501877:0:16464:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-clilmv-ffff8800a98fb800 (b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:01000000:0.0:1715205885.501922:0:16464:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdc-ffff8800a98fb800 (flags='') 00000020:00000080:0.0:1715205885.501923:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1715205885.501926:0:16464:0:(obd_config.c:900:class_cleanup()) lustre-MDT0000-mdc-ffff8800a98fb800: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1715205885.501927:0:16464:0:(genops.c:1485:class_disconnect_exports()) OBD device 8 (ffff88012e24aaa0) has no exports 00000008:01000000:0.0:1715205885.501952:0:16464:0:(obd_class.h:698:obd_cleanup_client_import()) lustre-MDT0000-mdc-ffff8800a98fb800: client import never connected 00000100:00080000:0.0:1715205885.501954:0:16464:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1715205885.501956:0:16464:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a98fb800: committing for last_committed 4294967317 gen 3 00000100:00100000:0.0:1715205885.501959:0:16464:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1715205885.503328:0:65:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff8800b0bc3800 for lustre-MDT0000-mdc-ffff8800a98fb800 00000020:00000080:0.0:1715205885.503382:0:16464:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1715205885.503387:0:16464:0:(obd_config.c:828:class_detach()) detach on obd lustre-MDT0000-mdc-ffff8800a98fb800 (uuid b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000020:00000080:0.0:1715205885.503389:0:16464:0:(genops.c:924:class_export_put()) final put ffff8800b0bc4000/b074247a-b4e0-48d1-8030-d4461b52d5ca 00000020:00000080:0.0:1715205885.503391:0:16464:0:(genops.c:882:class_export_destroy()) destroying export ffff8800b0bc4000/b074247a-b4e0-48d1-8030-d4461b52d5ca for lustre-MDT0000-mdc-ffff8800a98fb800 00000020:01000000:0.0:1715205885.503395:0:16464:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdc-ffff8800a98fb800 (b074247a-b4e0-48d1-8030-d4461b52d5ca) 00000080:02000400:0.0:1715205885.504969:0:16464:0:(llite_lib.c:1596:ll_put_super()) Unmounted lustre-client 00000020:01000000:0.0:1715205885.505895:0:16464:0:(obd_config.c:1142:class_del_profile()) Del profile lustre-client 00000020:01000004:0.0:1715205885.506126:0:16464:0:(obd_mount.c:976:lustre_common_put_super()) dropping sb ffff8800a98fb800 00000020:01000004:0.0:1715205885.506128:0:16464:0:(obd_mount.c:548:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000004:0.0:1715205885.506129:0:16464:0:(obd_mount.c:989:lustre_common_put_super()) MGC still in use 00000020:01000004:0.0:1715205885.506130:0:16464:0:(obd_mount.c:704:lustre_put_lsi()) put ffff8800a98fb800 1 00000020:01000004:0.0:1715205885.506132:0:16464:0:(obd_mount.c:629:lustre_free_lsi()) Freeing lsi ffff8800a98fa800 00000100:00080000:2.0:1715205885.511873:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715205885.511879:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00010000:00010000:3.0:1715205885.709985:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205886.020095:0:16674:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1715205886.712146:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205887.713964:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205888.715997:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205889.717922:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205889.901185:0:17263:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00080000:3.0:1715205890.519992:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715205890.519998:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715205890.520019:0:1964:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1964:1798523511136000:192.168.204.133@tcp:400:kworker.0 00000100:00100000:3.0:1715205890.521171:0:1964:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1964:1798523511136000:192.168.204.133@tcp:400:kworker.0 00000100:00100000:3.0:1715205890.703943:0:1956:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.133@tcp (source: 12345-192.168.204.133@tcp) 00000100:00100000:2.0:1715205890.704019:0:8446:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516386880 00000100:00100000:2.0:1715205890.704027:0:8446:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516386880 00000100:00100000:2.0:1715205890.704072:0:8446:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.133@tcp, seq: 9 00000100:00100000:2.0:1715205890.704079:0:8446:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:614fb888-a54c-4440-9a2f-efd4f3a141dd+3:25693:x1798523516386880:12345-192.168.204.133@tcp:104: 00010000:00010000:2.0:1715205890.704091:0:8446:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205890.704148:0:8446:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1715205890.704153:0:8446:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131038000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:614fb888-a54c-4440-9a2f-efd4f3a141dd+3:25693:x1798523516386880:12345-192.168.204.133@tcp:104: Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205890.704159:0:8446:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.133@tcp, seq: 9 00010000:00010000:1.0:1715205890.704211:0:16466:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205890.704223:0:16466:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205890.704231:0:16466:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a80b40 already unused, calling callback (ffffffffa0af4a40) 10000000:00010000:1.0:1715205890.704234:0:16466:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205890.704262:0:16466:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205890.704267:0:16466:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205890.704271:0:16466:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1715205890.704323:0:16466:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205890.704328:0:16466:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205890.704357:0:16466:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205890.704361:0:16466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800b0a80b40/0x361984fab9c06a9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345c9da expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205890.704381:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205890.704382:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205890.704384:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205890.704384:0:1963:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511136064:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1715205890.705249:0:1963:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511136064:192.168.204.133@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715205890.720109:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1715205891.341314:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205891.341338:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205891.341379:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341386:0:15828:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341393:0:15828:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00000100:00100000:0.0:1715205891.341407:0:15828:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b53c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205891.341415:0:15828:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:15828:1798523511136128:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205891.341423:0:15828:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341428:0:15828:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341433:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341438:0:15828:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341444:0:15828:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341449:0:15828:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa83cc0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205891.341451:0:15828:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341456:0:15828:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341469:0:15828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341473:0:15828:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205891.341477:0:15828:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341482:0:15828:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00000080:00020000:0.0:1715205891.341498:0:15828:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205891.341540:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205891.341546:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205891.341559:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341571:0:15828:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341576:0:15828:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00000100:00100000:0.0:1715205891.341583:0:15828:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b53c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205891.341587:0:15828:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:15828:1798523511136192:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205891.341592:0:15828:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341597:0:15828:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341601:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341610:0:15828:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341615:0:15828:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341619:0:15828:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa83a80 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205891.341622:0:15828:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341626:0:15828:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341630:0:15828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341634:0:15828:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205891.341637:0:15828:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341641:0:15828:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00000080:00020000:0.0:1715205891.341653:0:15828:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205891.341697:0:15828:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205891.341703:0:15828:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205891.341715:0:15828:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341720:0:15828:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341725:0:15828:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00000100:00100000:0.0:1715205891.341735:0:15828:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b53c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205891.341739:0:15828:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:15828:1798523511136256:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205891.341744:0:15828:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341748:0:15828:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341752:0:15828:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341756:0:15828:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341760:0:15828:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341764:0:15828:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa821c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205891.341766:0:15828:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341771:0:15828:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341776:0:15828:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341780:0:15828:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205891.341782:0:15828:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00010000:00010000:0.0:1715205891.341786:0:15828:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15828 initiator: MDT0 00000080:00020000:0.0:1715205891.341801:0:15828:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205891.344210:0:17572:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205891.344222:0:17572:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205891.344249:0:17572:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344256:0:17572:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344263:0:17572:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17572 initiator: MDT0 00000100:00100000:1.0:1715205891.344273:0:17572:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f8519c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715205891.344283:0:17572:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:17572:1798523511136320:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205891.344291:0:17572:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344296:0:17572:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344300:0:17572:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344305:0:17572:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344310:0:17572:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344314:0:17572:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a2880 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205891.344317:0:17572:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344321:0:17572:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344326:0:17572:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344330:0:17572:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205891.344333:0:17572:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344337:0:17572:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2880/0x361984fab9c06e4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17572 initiator: MDT0 00000080:00020000:1.0:1715205891.344350:0:17572:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205891.344380:0:17572:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205891.344386:0:17572:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205891.344400:0:17572:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344405:0:17572:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344410:0:17572:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17572 initiator: MDT0 00000100:00100000:1.0:1715205891.344416:0:17572:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f8519c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715205891.344421:0:17572:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:17572:1798523511136384:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205891.344426:0:17572:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344431:0:17572:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344435:0:17572:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344439:0:17572:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344443:0:17572:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344447:0:17572:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a2ac0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205891.344449:0:17572:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344454:0:17572:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344462:0:17572:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344467:0:17572:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205891.344469:0:17572:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17572 initiator: MDT0 00010000:00010000:1.0:1715205891.344473:0:17572:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2ac0/0x361984fab9c06e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17572 initiator: MDT0 00000080:00020000:1.0:1715205891.344484:0:17572:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715205891.721928:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1715205892.273903:0:4789:0:(mgc_request.c:626:do_requeue()) updating log params 10000000:01000000:2.0:1715205892.273910:0:4789:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff880136899800 from 7 10000000:01000000:2.0:1715205892.273914:0:4789:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1715205892.273954:0:4789:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205892.273963:0:4789:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205892.273971:0:4789:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205892.273993:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511136448:192.168.204.133@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715205892.274062:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205892.275072:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511136448:192.168.204.133@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1715205892.275089:0:4789:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205892.275097:0:4789:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205892.275138:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511136512:192.168.204.133@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1715205892.275165:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715205892.276296:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511136512:192.168.204.133@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1715205892.276323:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511136576:192.168.204.133@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1715205892.276361:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715205892.277457:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511136576:192.168.204.133@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715205892.277740:0:17989:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:17989:1798523511136640:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715205892.277789:0:17989:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5bfa000 going to sleep for 11 seconds 00000100:00100000:3.0:1715205892.278804:0:17989:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:17989:1798523511136640:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715205892.278870:0:17989:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715205892.278877:0:17989:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205892.278878:0:17989:0:(obd_config.c:1497:class_process_config()) marker 4 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1715205892.278883:0:17989:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff880136899800 00000020:00000080:3.0:1715205892.278885:0:17989:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1715205892.278947:0:17989:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:17989:1798523511136704:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715205892.278979:0:17989:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5bfa000 going to sleep for 11 seconds 00000100:00100000:2.0:1715205892.279999:0:17989:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:17989:1798523511136704:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:2.0:1715205892.280020:0:17989:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1715205892.280024:0:17989:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1715205892.280025:0:17989:0:(obd_config.c:1497:class_process_config()) marker 4 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1715205892.280028:0:17989:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1715205892.280063:0:4789:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1715205892.280081:0:4789:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1715205892.280088:0:4789:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205892.280105:0:4789:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205892.723916:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205893.725942:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205894.283888:0:18286:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 18:04:53 (1715205893) 00010000:00010000:0.0:1715205894.727927:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1715205895.528098:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715205895.528105:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715205895.528121:0:1963:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1715205895.528144:0:1963:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511136768:192.168.204.133@tcp:400:kworker.0 00000100:00100000:0.0:1715205895.529238:0:1963:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511136768:192.168.204.133@tcp:400:kworker.0 00010000:00010000:1.0:1715205895.729983:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205896.731993:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205897.585316:0:18723:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 28 102 00010000:00010000:0.0:1715205897.733891:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205897.895463:0:18875:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 33a 00000080:00200008:0.0:1715205897.924171:0:18302:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205897.924178:0:18302:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205897.924198:0:18302:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205897.924252:0:18302:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924261:0:18302:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924270:0:18302:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00000100:00100000:0.0:1715205897.924296:0:18302:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205897.924306:0:18302:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:18302:1798523511136832:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205897.924314:0:18302:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924320:0:18302:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924325:0:18302:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924338:0:18302:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924344:0:18302:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924349:0:18302:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa821c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205897.924353:0:18302:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924358:0:18302:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924364:0:18302:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924369:0:18302:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205897.924373:0:18302:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.924378:0:18302:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa821c0/0x361984fab9c06e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00000080:00020000:0.0:1715205897.924396:0:18302:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715205897.930252:0:18302:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205897.930257:0:18302:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205897.930275:0:18302:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205897.930325:0:18302:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930331:0:18302:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930358:0:18302:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00000100:00100000:0.0:1715205897.930376:0:18302:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205897.930387:0:18302:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:18302:1798523511136896:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205897.930397:0:18302:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930403:0:18302:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930409:0:18302:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930415:0:18302:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930422:0:18302:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930427:0:18302:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa83a80 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205897.930431:0:18302:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930436:0:18302:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930442:0:18302:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930447:0:18302:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205897.930452:0:18302:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.930461:0:18302:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83a80/0x361984fab9c06e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00000080:00020000:0.0:1715205897.930482:0:18302:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715205897.935761:0:18302:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205897.935767:0:18302:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205897.935783:0:18302:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205897.935850:0:18302:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935856:0:18302:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935861:0:18302:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00000100:00100000:0.0:1715205897.935874:0:18302:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205897.935882:0:18302:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:18302:1798523511136960:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205897.935888:0:18302:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935893:0:18302:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935896:0:18302:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935899:0:18302:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935903:0:18302:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935909:0:18302:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa83cc0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205897.935912:0:18302:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935915:0:18302:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935919:0:18302:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935922:0:18302:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205897.935925:0:18302:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.935928:0:18302:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83cc0/0x361984fab9c06e71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00000080:00020000:0.0:1715205897.935940:0:18302:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715205897.935979:0:18302:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012e7400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205897.935982:0:18302:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205897.935986:0:18302:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205897.935996:0:18302:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936000:0:18302:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936003:0:18302:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00000100:00100000:0.0:1715205897.936007:0:18302:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205897.936010:0:18302:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:18302:1798523511137024:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205897.936017:0:18302:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936020:0:18302:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936024:0:18302:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936026:0:18302:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936029:0:18302:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936031:0:18302:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa83600 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205897.936032:0:18302:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936035:0:18302:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936037:0:18302:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936039:0:18302:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205897.936041:0:18302:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205897.936043:0:18302:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83600/0x361984fab9c06e78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00000080:00020000:0.0:1715205897.936050:0:18302:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:01200004:0.0:1715205897.991407:0:18931:0:(super25.c:129:lustre_fill_super()) VFS Op: sb ffff8800a98fe800 00000020:01000004:0.0:1715205897.991428:0:18931:0:(obd_mount.c:1002:lmd_print()) mount data: 00000020:01000004:0.0:1715205897.991429:0:18931:0:(obd_mount.c:1004:lmd_print()) profile: lustre-client 00000020:01000004:0.0:1715205897.991430:0:18931:0:(obd_mount.c:1005:lmd_print()) device: 192.168.204.133@tcp:/lustre 00000020:01000004:0.0:1715205897.991431:0:18931:0:(obd_mount.c:1008:lmd_print()) options: user_xattr,flock 00000080:01000004:0.0:1715205897.991432:0:18931:0:(super25.c:172:lustre_fill_super()) Mounting client lustre-client 00000020:01000004:0.0:1715205897.991450:0:18931:0:(obd_mount.c:352:lustre_start_mgc()) MGC192.168.204.133@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1715205897.991452:0:18931:0:(mgc_request.c:1063:mgc_set_info_async()) InitRecov MGC192.168.204.133@tcp 1/d0:i0:r0:or0:FULL 00000080:00200000:0.0:1715205897.991456:0:18931:0:(llite_lib.c:1367:ll_fill_super()) VFS Op: cfg_instance lustre-client-ffff8800a98fe800 (sb ffff8800a98fe800) 00000080:01000000:0.0:1715205897.991513:0:18931:0:(llite_lib.c:1088:ll_options()) Parsing opts user_xattr,flock 00000080:00000004:0.0:1715205897.991514:0:18931:0:(llite_lib.c:1098:ll_options()) next opt=user_xattr 00000080:00000004:0.0:1715205897.991515:0:18931:0:(llite_lib.c:1098:ll_options()) next opt=flock 00000080:01000000:0.0:1715205897.991522:0:18931:0:(llite_lib.c:1401:ll_fill_super()) llite sb uuid: d0b65fb1-a2bf-4259-8680-142a231e8789 10000000:01000000:0.0:1715205897.991725:0:18931:0:(mgc_request.c:1899:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1715205897.991728:0:18931:0:(mgc_request.c:342:config_log_add()) add config log lustre-client-ffff8800a98fe800 10000000:01000000:0.0:1715205897.991733:0:18931:0:(mgc_request.c:214:do_config_log_add()) do adding config log params-ffff8800a98fe800 10000000:01000000:0.0:1715205897.991736:0:18931:0:(mgc_request.c:88:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1715205897.991739:0:18931:0:(mgc_request.c:214:do_config_log_add()) do adding config log lustre-client-ffff8800a98fe800 10000000:01000000:0.0:1715205897.991741:0:18931:0:(mgc_request.c:88:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1715205897.991744:0:18931:0:(mgc_request.c:214:do_config_log_add()) do adding config log lustre-cliir-ffff8800a98fe800 10000000:01000000:0.0:1715205897.991745:0:18931:0:(mgc_request.c:88:mgc_name2resid()) log lustre-cliir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1715205897.991748:0:18931:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800a98fe800 from 1 10000000:01000000:0.0:1715205897.991751:0:18931:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1715205897.991798:0:18931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa83840/0x361984fab9c06e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205897.991807:0:18931:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff8800aaa83840/0x361984fab9c06e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205897.991833:0:18931:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff8800aaa83840/0x361984fab9c06e7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205897.991854:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137088:192.168.204.133@tcp:101:mount.lustre.0 00000100:00100000:0.0:1715205897.991924:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205897.993688:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137088:192.168.204.133@tcp:101:mount.lustre.0 00010000:00010000:0.0:1715205897.993703:0:18931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff8800aaa83840/0x361984fab9c06e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb23 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205897.993712:0:18931:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff8800aaa83840/0x361984fab9c06e7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345cb23 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205897.993754:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137152:192.168.204.133@tcp:501:mount.lustre.0 00000100:00100000:0.0:1715205897.993779:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205897.994384:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137152:192.168.204.133@tcp:501:mount.lustre.0 00000100:00100000:0.0:1715205897.994403:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137216:192.168.204.133@tcp:503:mount.lustre.0 00000100:00100000:0.0:1715205897.994443:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205897.995117:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137216:192.168.204.133@tcp:503:mount.lustre.0 00000100:00100000:3.0:1715205897.995375:0:18934:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18934:1798523511137280:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715205897.995445:0:18934:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b5bfa540 going to sleep for 11 seconds 00000100:00100000:3.0:1715205897.996218:0:18934:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131038700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18934:1798523511137280:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715205897.996241:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715205897.996248:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.996250:0:18934:0:(obd_config.c:1497:class_process_config()) marker 4 (0x1) lustre-clilov lov setup 00000020:01000000:3.0:1715205897.996254:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-clilov-ffff8800a98fe800 00000020:00000080:3.0:1715205897.996257:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1715205897.996267:0:18934:0:(genops.c:436:class_newdev()) Allocate new device lustre-clilov-ffff8800a98fe800 (ffff8800aaa66a90) 00000020:00000080:3.0:1715205897.996280:0:18934:0:(obd_config.c:671:class_attach()) OBD: dev 6 attached type lov with refcount 2 00000020:01000000:3.0:1715205897.996286:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-clilov-ffff8800a98fe800 00000020:00000080:3.0:1715205897.996288:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00000020:00000080:3.0:1715205897.996468:0:18934:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-clilov-ffff8800a98fe800 (uuid d0b65fb1-a2bf-4259-8680-142a231e8789) 00000020:01000000:3.0:1715205897.996471:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.996474:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.996475:0:18934:0:(obd_config.c:1497:class_process_config()) marker 4 (0x2) lustre-clilov lov setup 00000020:01000000:3.0:1715205897.996477:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715205897.996479:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.996480:0:18934:0:(obd_config.c:1497:class_process_config()) marker 5 (0x1) lustre-clilmv lmv setup 00000020:01000000:3.0:1715205897.996483:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-clilmv-ffff8800a98fe800 00000020:00000080:3.0:1715205897.996485:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1715205897.996497:0:18934:0:(genops.c:436:class_newdev()) Allocate new device lustre-clilmv-ffff8800a98fe800 (ffff8800a9888000) 00000020:00000080:3.0:1715205897.996504:0:18934:0:(obd_config.c:671:class_attach()) OBD: dev 7 attached type lmv with refcount 2 00000020:01000000:3.0:1715205897.996509:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-clilmv-ffff8800a98fe800 00000020:00000080:3.0:1715205897.996510:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00000020:00000080:3.0:1715205897.996588:0:18934:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-clilmv-ffff8800a98fe800 (uuid d0b65fb1-a2bf-4259-8680-142a231e8789) 00000020:01000000:3.0:1715205897.996591:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.996596:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.996597:0:18934:0:(obd_config.c:1497:class_process_config()) marker 5 (0x2) lustre-clilmv lmv setup 00000020:01000000:3.0:1715205897.996599:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715205897.996601:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.996602:0:18934:0:(obd_config.c:1497:class_process_config()) marker 6 (0x1) lustre-client mount opts 00000020:00000080:3.0:1715205897.996604:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1715205897.996606:0:18934:0:(obd_config.c:1450:class_process_config()) mountopt: profile lustre-client osc lustre-clilov mdc lustre-clilmv 00000020:01000000:3.0:1715205897.996608:0:18934:0:(obd_config.c:1090:class_add_profile()) Add profile lustre-client 00000020:01000000:3.0:1715205897.996610:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.996612:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.996613:0:18934:0:(obd_config.c:1497:class_process_config()) marker 6 (0x2) lustre-client mount opts 00000020:01000000:3.0:1715205897.996614:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715205897.996617:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.996618:0:18934:0:(obd_config.c:1497:class_process_config()) marker 7 (0x1) lustre-MDT0000 add mdc 00000020:00000080:3.0:1715205897.996620:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1715205897.996623:0:18934:0:(obd_config.c:1421:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:3.0:1715205897.996633:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-MDT0000-mdc-ffff8800a98fe800 00000020:00000080:3.0:1715205897.996634:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1715205897.996640:0:18934:0:(genops.c:436:class_newdev()) Allocate new device lustre-MDT0000-mdc-ffff8800a98fe800 (ffff8800a9889550) 00000020:00000080:3.0:1715205897.996647:0:18934:0:(obd_config.c:671:class_attach()) OBD: dev 8 attached type mdc with refcount 2 00000020:01000000:3.0:1715205897.996650:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-MDT0000-mdc-ffff8800a98fe800 00000020:00000080:3.0:1715205897.996652:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00010000:00080000:3.0:1715205897.996696:0:18934:0:(ldlm_lib.c:119:import_set_conn()) imp ffff88012b367000@lustre-MDT0000-mdc-ffff8800a98fe800: add connection 192.168.204.133@tcp at head 00010000:00010000:3.0:1715205897.997910:0:18934:0:(ldlm_pool.c:943:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-mdc-ffff8800a98fe800-4 is initialized 00000040:01000000:3.0:1715205897.998019:0:18934:0:(llog_obd.c:212:llog_setup()) obd lustre-MDT0000-mdc-ffff8800a98fe800 ctxt 13 is initialized 00000020:00000080:3.0:1715205897.998035:0:18934:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-MDT0000-mdc-ffff8800a98fe800 (uuid d0b65fb1-a2bf-4259-8680-142a231e8789) 00000020:01000000:3.0:1715205897.998040:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf014, instance name: lustre-clilmv-ffff8800a98fe800 00000020:00000080:3.0:1715205897.998041:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf014 00800000:01000000:3.0:1715205897.998047:0:18934:0:(lmv_obd.c:432:lmv_add_target()) Target uuid: lustre-MDT0000_UUID. index 0 00000020:01000000:3.0:1715205897.998066:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.998068:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998069:0:18934:0:(obd_config.c:1497:class_process_config()) marker 7 (0x2) lustre-MDT0000 add mdc 00000020:01000000:3.0:1715205897.998075:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1715205897.998077:0:18934:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1715205897.998078:0:18934:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1715205897.998079:0:18934:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1715205897.998080:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1715205897.998081:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998082:0:18934:0:(obd_config.c:1497:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1715205897.998083:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1715205897.998085:0:18934:0:(obd_mount.c:1040:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of 192.168.204.133@tcp:/lustre 00000020:00000080:3.0:1715205897.998087:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998088:0:18934:0:(obd_config.c:1497:class_process_config()) marker 13 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1715205897.998089:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1715205897.998091:0:18934:0:(obd_config.c:1421:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:3.0:1715205897.998097:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-OST0000-osc-ffff8800a98fe800 00000020:00000080:3.0:1715205897.998099:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1715205897.998103:0:18934:0:(genops.c:436:class_newdev()) Allocate new device lustre-OST0000-osc-ffff8800a98fe800 (ffff8800a988aaa0) 00000020:00000080:3.0:1715205897.998111:0:18934:0:(obd_config.c:671:class_attach()) OBD: dev 9 attached type osc with refcount 2 00000020:01000000:3.0:1715205897.998114:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-OST0000-osc-ffff8800a98fe800 00000020:00000080:3.0:1715205897.998115:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00010000:00080000:3.0:1715205897.998147:0:18934:0:(ldlm_lib.c:119:import_set_conn()) imp ffff8800b6761000@lustre-OST0000-osc-ffff8800a98fe800: add connection 192.168.204.133@tcp at head 00010000:00010000:3.0:1715205897.998278:0:18934:0:(ldlm_pool.c:943:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-ffff8800a98fe800-5 is initialized 00000020:00000080:3.0:1715205897.998405:0:18934:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-OST0000-osc-ffff8800a98fe800 (uuid d0b65fb1-a2bf-4259-8680-142a231e8789) 00000020:01000000:3.0:1715205897.998409:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf00d, instance name: lustre-clilov-ffff8800a98fe800 00000020:00000080:3.0:1715205897.998411:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00d 00020000:01000000:3.0:1715205897.998419:0:18934:0:(lov_obd.c:489:lov_add_target()) uuid:lustre-OST0000_UUID idx:0 gen:1 active:1 00020000:01000000:3.0:1715205897.998423:0:18934:0:(lov_obd.c:540:lov_add_target()) tgts: ffff8800aaab83d0 size: 2 00020000:01000000:3.0:1715205897.998425:0:18934:0:(lov_obd.c:569:lov_add_target()) idx=0 ltd_gen=1 ld_tgt_count=1 00000020:01000000:3.0:1715205897.998430:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.998432:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998433:0:18934:0:(obd_config.c:1497:class_process_config()) marker 13 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1715205897.998435:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1715205897.998436:0:18934:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1715205897.998440:0:18934:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1715205897.998441:0:18934:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1715205897.998442:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1715205897.998443:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998444:0:18934:0:(obd_config.c:1497:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1715205897.998446:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1715205897.998448:0:18934:0:(obd_mount.c:1040:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of 192.168.204.133@tcp:/lustre 00000020:00000080:3.0:1715205897.998450:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998450:0:18934:0:(obd_config.c:1497:class_process_config()) marker 19 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1715205897.998452:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1715205897.998454:0:18934:0:(obd_config.c:1421:class_process_config()) adding mapping from uuid 192.168.204.133@tcp to nid 0x20000c0a8cc85 (192.168.204.133@tcp) 00000020:01000000:3.0:1715205897.998460:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-OST0001-osc-ffff8800a98fe800 00000020:00000080:3.0:1715205897.998461:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1715205897.998465:0:18934:0:(genops.c:436:class_newdev()) Allocate new device lustre-OST0001-osc-ffff8800a98fe800 (ffff8800a988bff0) 00000020:00000080:3.0:1715205897.998471:0:18934:0:(obd_config.c:671:class_attach()) OBD: dev 10 attached type osc with refcount 2 00000020:01000000:3.0:1715205897.998473:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-OST0001-osc-ffff8800a98fe800 00000020:00000080:3.0:1715205897.998475:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00010000:00080000:3.0:1715205897.998504:0:18934:0:(ldlm_lib.c:119:import_set_conn()) imp ffff8800b67a0000@lustre-OST0001-osc-ffff8800a98fe800: add connection 192.168.204.133@tcp at head 00010000:00010000:3.0:1715205897.998648:0:18934:0:(ldlm_pool.c:943:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-ffff8800a98fe800-6 is initialized 00000020:00000080:3.0:1715205897.998759:0:18934:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-OST0001-osc-ffff8800a98fe800 (uuid d0b65fb1-a2bf-4259-8680-142a231e8789) 00000020:01000000:3.0:1715205897.998764:0:18934:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf00d, instance name: lustre-clilov-ffff8800a98fe800 00000020:00000080:3.0:1715205897.998766:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00d 00020000:01000000:3.0:1715205897.998773:0:18934:0:(lov_obd.c:489:lov_add_target()) uuid:lustre-OST0001_UUID idx:1 gen:1 active:1 00020000:01000000:3.0:1715205897.998777:0:18934:0:(lov_obd.c:569:lov_add_target()) idx=1 ltd_gen=1 ld_tgt_count=2 00000020:01000000:3.0:1715205897.998795:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.998798:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998799:0:18934:0:(obd_config.c:1497:class_process_config()) marker 19 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1715205897.998802:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715205897.998804:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998805:0:18934:0:(obd_config.c:1497:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1715205897.998806:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1715205897.998808:0:18934:0:(obd_config.c:1471:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1715205897.998829:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.998831:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998832:0:18934:0:(obd_config.c:1497:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1715205897.998834:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715205897.998836:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.998837:0:18934:0:(obd_config.c:1497:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1715205897.998839:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1715205897.998860:0:18934:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013103a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18934:1798523511137344:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715205897.998972:0:18934:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715205897.999911:0:18934:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18934:1798523511137344:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715205897.999926:0:18934:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715205897.999928:0:18934:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715205897.999928:0:18934:0:(obd_config.c:1497:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1715205897.999930:0:18934:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1715205897.999971:0:18931:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1715205897.999993:0:18931:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1715205898.000007:0:18931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa83840/0x361984fab9c06e7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb23 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.000015:0:18931:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff8800aaa83840/0x361984fab9c06e7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb23 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715205898.000020:0:18931:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-cliir-ffff8800a98fe800 from 1 10000000:01000000:0.0:1715205898.000022:0:18931:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:0.0:1715205898.000042:0:18931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.000046:0:18931:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.000056:0:18931:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06ea9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205898.000069:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137408:192.168.204.133@tcp:101:mount.lustre.0 00000100:00100000:0.0:1715205898.000109:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205898.000646:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137408:192.168.204.133@tcp:101:mount.lustre.0 00010000:00010000:0.0:1715205898.000656:0:18931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06ea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb2a expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.000662:0:18931:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06ea9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345cb2a expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205898.001044:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137472:192.168.204.133@tcp:256:mount.lustre.0 00000100:00100000:0.0:1715205898.001076:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205898.001938:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137472:192.168.204.133@tcp:256:mount.lustre.0 00000020:00000080:0.0:1715205898.001963:0:18931:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1715205898.002028:0:18931:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1715205898.002054:0:18931:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 10000000:01000000:0.0:1715205898.002435:0:18931:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:0.0:1715205898.002450:0:18931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06ea9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb2a expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.002455:0:18931:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff8800aaa818c0/0x361984fab9c06ea9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb2a expref: -99 pid: 18931 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715205898.002459:0:18931:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff8800a98fe800 from 1 10000000:01000000:0.0:1715205898.002460:0:18931:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1715205898.002471:0:18931:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.002475:0:18931:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.002479:0:18931:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205898.002486:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137536:192.168.204.133@tcp:101:mount.lustre.0 00000100:00100000:0.0:1715205898.002508:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205898.003139:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137536:192.168.204.133@tcp:101:mount.lustre.0 00010000:00010000:0.0:1715205898.003148:0:18931:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205898.003154:0:18931:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205898.003183:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137600:192.168.204.133@tcp:501:mount.lustre.0 00000100:00100000:0.0:1715205898.003211:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205898.003732:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137600:192.168.204.133@tcp:501:mount.lustre.0 00000100:00100000:0.0:1715205898.003755:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137664:192.168.204.133@tcp:503:mount.lustre.0 00000100:00100000:0.0:1715205898.003804:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa9b5480 going to sleep for 11 seconds 00000100:00100000:1.0:1715205898.004450:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:614fb888-a54c-4440-9a2f-efd4f3a141dd:18931:1798523511137664:192.168.204.133@tcp:503:mount.lustre.0 00000100:00100000:1.0:1715205898.004544:0:18939:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18939:1798523511137728:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205898.004586:0:18939:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851840 going to sleep for 11 seconds 00000100:00100000:1.0:1715205898.005235:0:18939:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18939:1798523511137728:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205898.005257:0:18939:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1715205898.005261:0:18939:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #2 00000020:01000000:1.0:1715205898.005262:0:18939:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205898.005264:0:18939:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205898.005265:0:18939:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1715205898.005269:0:18939:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205898.005270:0:18939:0:(obd_config.c:1497:class_process_config()) marker 2 (0x6) general lod.*.mdt_hash 00000020:01000000:1.0:1715205898.005273:0:18939:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1715205898.005275:0:18939:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #3 00000020:01000000:1.0:1715205898.005276:0:18939:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205898.005277:0:18939:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205898.005282:0:18939:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1715205898.005284:0:18939:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205898.005285:0:18939:0:(obd_config.c:1497:class_process_config()) marker 3 (0x6) general lod.*.mdt_hash 00000020:01000000:1.0:1715205898.005287:0:18939:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205898.005289:0:18939:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205898.005290:0:18939:0:(obd_config.c:1497:class_process_config()) marker 4 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1715205898.005293:0:18939:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff8800a98fe800 00000020:00000080:1.0:1715205898.005295:0:18939:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1715205898.005780:0:18939:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18939:1798523511137792:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205898.005844:0:18939:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851840 going to sleep for 11 seconds 00000100:00100000:1.0:1715205898.006462:0:18939:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:18939:1798523511137792:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205898.006480:0:18939:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205898.006482:0:18939:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205898.006483:0:18939:0:(obd_config.c:1497:class_process_config()) marker 4 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1715205898.006485:0:18939:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1715205898.006503:0:18931:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1715205898.006516:0:18931:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1715205898.006526:0:18931:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205898.006531:0:18931:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00000080:01000000:2.0:1715205898.006538:0:18931:0:(llite_lib.c:1471:ll_fill_super()) Found profile lustre-client: mdc=lustre-clilmv osc=lustre-clilov 00000020:00000080:2.0:1715205898.006551:0:18931:0:(genops.c:1312:class_connect()) connect: client d0b65fb1-a2bf-4259-8680-142a231e8789, cookie 0x361984fab9c06eb7 00800000:01000000:2.0:1715205898.006567:0:18931:0:(lmv_obd.c:505:lmv_check_connect()) Time to connect d0b65fb1-a2bf-4259-8680-142a231e8789 to lustre-clilmv-ffff8800a98fe800 00800000:01000000:2.0:1715205898.006572:0:18931:0:(lmv_obd.c:345:lmv_connect_mdc()) connect to lustre-MDT0000-mdc-ffff8800a98fe800(d0b65fb1-a2bf-4259-8680-142a231e8789) - lustre-MDT0000_UUID, d0b65fb1-a2bf-4259-8680-142a231e8789 00000020:00000080:2.0:1715205898.006577:0:18931:0:(genops.c:1312:class_connect()) connect: client d0b65fb1-a2bf-4259-8680-142a231e8789, cookie 0x361984fab9c06ebe 00000100:00080000:2.0:1715205898.006581:0:18931:0:(import.c:523:import_select_connection()) lustre-MDT0000-mdc-ffff8800a98fe800: connect to NID 192.168.204.133@tcp last attempt 0 00000100:00080000:2.0:1715205898.006586:0:18931:0:(import.c:615:import_select_connection()) lustre-MDT0000-mdc-ffff8800a98fe800: import ffff88012b367000 using connection 192.168.204.133@tcp/192.168.204.133@tcp 00000008:00100000:2.0:1715205898.006594:0:18931:0:(osc_request.c:3582:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34553605 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1715205898.006606:0:18931:0:(import.c:814:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800aa865180 x1798523511137856/t0(0) o38->lustre-MDT0000-mdc-ffff8800a98fe800@192.168.204.133@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00080000:2.0:1715205898.006622:0:18931:0:(pinger.c:395:ptlrpc_pinger_add_import()) adding pingable import d0b65fb1-a2bf-4259-8680-142a231e8789->lustre-MDT0000_UUID 00000100:00080000:0.0:1715205898.006651:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715205898.006654:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715205898.006655:0:1961:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0b65fb1-a2bf-4259-8680-142a231e8789:1961:1798523511137856:192.168.204.133@tcp:38:mount.lustre.0 00800000:01000000:2.0:1715205898.006658:0:18931:0:(lmv_obd.c:402:lmv_connect_mdc()) Connected to lustre-MDT0000-mdc-ffff8800a98fe800(d0b65fb1-a2bf-4259-8680-142a231e8789) successfully (5) 00800000:00000004:2.0:1715205898.006660:0:18931:0:(obd_class.h:1105:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800a98fe800: age -749, max_age 0 00000080:00000004:2.0:1715205898.006682:0:18931:0:(obd_class.h:1136:obd_statfs()) lustre-clilmv-ffff8800a98fe800: age -749, max_age 250 00800000:00000004:2.0:1715205898.006691:0:18931:0:(obd_class.h:1136:obd_statfs()) lustre-MDT0000-mdc-ffff8800a98fe800: age -749, max_age 250 00000100:00080000:2.0:1715205898.006705:0:18931:0:(client.c:1702:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8800aa864380 x1798523511137984/t0(0) o41->lustre-MDT0000-mdc-ffff8800a98fe800@192.168.204.133@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:2.0:1715205898.006712:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3b40 going to sleep for 0 seconds 00000100:00080000:3.0:1715205898.006724:0:1965:0:(client.c:1702:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8800aa864700 x1798523511137920/t0(0) o41->lustre-MDT0000-mdc-ffff8800a98fe800@192.168.204.133@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:3.0:1715205898.007464:0:1961:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a98fe800: committing for last_committed 0 gen 1 00000100:00080000:3.0:1715205898.007472:0:1961:0:(import.c:1087:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff8800a98fe800: connect to target with instance 1 00000100:00080000:3.0:1715205898.007479:0:1961:0:(import.c:940:ptlrpc_connect_set_flags()) lustre-MDT0000-mdc-ffff8800a98fe800: Resetting ns_connect_flags to server flags: 0xae7a5e7be344d3b8 00000100:00080000:3.0:1715205898.007487:0:1961:0:(import.c:1168:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1715205898.007489:0:1961:0:(import.c:86:import_set_state_nolock()) ffff88012b367000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1715205898.007587:0:1961:0:(recover.c:204:ptlrpc_wake_delayed()) @@@ waking (set ffff88012dba3b40): req@ffff8800aa864380 x1798523511137984/t0(0) o41->lustre-MDT0000-mdc-ffff8800a98fe800@192.168.204.133@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00080000:2.0:1715205898.007597:0:1961:0:(recover.c:204:ptlrpc_wake_delayed()) @@@ waking (set ffff8800b6790d80): req@ffff8800aa864700 x1798523511137920/t0(0) o41->lustre-MDT0000-mdc-ffff8800a98fe800@192.168.204.133@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:2.0:1715205898.007610:0:1961:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0b65fb1-a2bf-4259-8680-142a231e8789:1961:1798523511137856:192.168.204.133@tcp:38:mount.lustre.0 00000100:00100000:2.0:1715205898.007643:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1715205898.008273:0:1965:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa864700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:d0b65fb1-a2bf-4259-8680-142a231e8789:0:1798523511137920:192.168.204.133@tcp:41:mount.lustre.0 00000100:00100000:3.0:1715205898.008305:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa864380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0b65fb1-a2bf-4259-8680-142a231e8789:18931:1798523511137984:192.168.204.133@tcp:41:mount.lustre.0 00800000:00000004:3.0:1715205898.008314:0:18931:0:(obd_class.h:1162:obd_statfs()) lustre-MDT0000-mdc-ffff8800a98fe800: update ffff8800a9889878 cache blocks 17230/17271 objects 499325/499659 00000080:00000004:3.0:1715205898.008320:0:18931:0:(obd_class.h:1162:obd_statfs()) lustre-clilmv-ffff8800a98fe800: update ffff8800a9888328 cache blocks 17230/17271 objects 499325/499659 00000080:00100000:3.0:1715205898.008334:0:18931:0:(llite_lib.c:631:client_common_fill_super()) ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 34553605 ocd_grant: 3407872 00020000:01000000:3.0:1715205898.008339:0:18931:0:(lov_obd.c:208:lov_connect()) connect #0 00000020:00000080:3.0:1715205898.008344:0:18931:0:(genops.c:1312:class_connect()) connect: client d0b65fb1-a2bf-4259-8680-142a231e8789, cookie 0x361984fab9c06ec5 00000020:00000080:3.0:1715205898.008354:0:18931:0:(genops.c:1312:class_connect()) connect: client LOV_OSC_UUID, cookie 0x361984fab9c06ecc 00000100:00080000:3.0:1715205898.008358:0:18931:0:(import.c:523:import_select_connection()) lustre-OST0000-osc-ffff8800a98fe800: connect to NID 192.168.204.133@tcp last attempt 0 00000100:00080000:3.0:1715205898.008363:0:18931:0:(import.c:615:import_select_connection()) lustre-OST0000-osc-ffff8800a98fe800: import ffff8800b6761000 using connection 192.168.204.133@tcp/192.168.204.133@tcp 00000008:00100000:3.0:1715205898.008370:0:18931:0:(osc_request.c:3582:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 34553605 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1715205898.008385:0:18931:0:(import.c:814:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88013103a680 x1798523511138048/t0(0) o8->lustre-OST0000-osc-ffff8800a98fe800@192.168.204.133@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00080000:3.0:1715205898.008408:0:18931:0:(pinger.c:395:ptlrpc_pinger_add_import()) adding pingable import d0b65fb1-a2bf-4259-8680-142a231e8789->lustre-OST0000_UUID 00020000:01000000:3.0:1715205898.008421:0:18931:0:(lov_obd.c:180:lov_connect_osc()) Connected tgt idx 0 lustre-OST0000_UUID (lustre-OST0000-osc-ffff8800a98fe800) active 00000100:00100000:2.0:1715205898.008431:0:1961:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013103a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0b65fb1-a2bf-4259-8680-142a231e8789:1961:1798523511138048:192.168.204.133@tcp:8:mount.lustre.0 00000080:00000004:3.0:1715205898.008436:0:18931:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0x0 -> 0xa0465af2e3640078 00000020:00000080:3.0:1715205898.008443:0:18931:0:(genops.c:1312:class_connect()) connect: client LOV_OSC_UUID, cookie 0x361984fab9c06ed3 00000100:00080000:0.0:1715205898.008446:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715205898.008447:0:18931:0:(import.c:523:import_select_connection()) lustre-OST0001-osc-ffff8800a98fe800: connect to NID 192.168.204.133@tcp last attempt 0 00000100:00080000:0.0:1715205898.008457:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715205898.008458:0:18931:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-ffff8800a98fe800: import ffff8800b67a0000 using connection 192.168.204.133@tcp/192.168.204.133@tcp 00000008:00100000:3.0:1715205898.008463:0:18931:0:(osc_request.c:3582:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 34553605 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1715205898.008472:0:18931:0:(import.c:814:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff880131039880 x1798523511138112/t0(0) o8->lustre-OST0001-osc-ffff8800a98fe800@192.168.204.133@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00080000:3.0:1715205898.008483:0:18931:0:(pinger.c:395:ptlrpc_pinger_add_import()) adding pingable import d0b65fb1-a2bf-4259-8680-142a231e8789->lustre-OST0001_UUID 00020000:01000000:3.0:1715205898.008490:0:18931:0:(lov_obd.c:180:lov_connect_osc()) Connected tgt idx 1 lustre-OST0001_UUID (lustre-OST0001-osc-ffff8800a98fe800) active 00000100:00100000:2.0:1715205898.008493:0:1961:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0b65fb1-a2bf-4259-8680-142a231e8789:1961:1798523511138112:192.168.204.133@tcp:8:mount.lustre.0 00000080:00000004:3.0:1715205898.008495:0:18931:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0x0 -> 0xa0465af2e3640078 00000100:00080000:0.0:1715205898.008495:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715205898.008497:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715205898.008511:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013103a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0b65fb1-a2bf-4259-8680-142a231e8789:18931:1798523511138176:192.168.204.133@tcp:40:mount.lustre.0 00000100:00100000:3.0:1715205898.008529:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989a180 going to sleep for 11 seconds 00000100:00100000:3.0:1715205898.009155:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0b65fb1-a2bf-4259-8680-142a231e8789:18931:1798523511138176:192.168.204.133@tcp:40:mount.lustre.0 00000080:00000004:3.0:1715205898.009164:0:18931:0:(llite_lib.c:710:client_common_fill_super()) rootfid [0x200000007:0x1:0x0] 00000100:00100000:3.0:1715205898.009185:0:18931:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013103a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0b65fb1-a2bf-4259-8680-142a231e8789:18931:1798523511138240:192.168.204.133@tcp:33:mount.lustre.0 00000100:00100000:3.0:1715205898.009217:0:18931:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989a180 going to sleep for 11 seconds 00000100:00100000:2.0:1715205898.009322:0:1961:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8800a98fe800: committing for last_committed 0 gen 1 00000100:00080000:2.0:1715205898.009327:0:1961:0:(import.c:1087:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8800a98fe800: connect to target with instance 1 00000100:00080000:2.0:1715205898.009333:0:1961:0:(import.c:940:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8800a98fe800: Resetting ns_connect_flags to server flags: 0xa0425af2e3440078 00000080:00000004:2.0:1715205898.009340:0:1961:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0465af2e3640078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1715205898.009344:0:1961:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1715205898.009349:0:1961:0:(import.c:1168:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1715205898.009352:0:1961:0:(import.c:86:import_set_state_nolock()) ffff8800b67a0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00020000:01000000:2.0:1715205898.009356:0:1961:0:(lov_obd.c:410:lov_set_osc_active()) Marking OSC lustre-OST0001_UUID active 00000080:00000004:2.0:1715205898.009359:0:1961:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1715205898.009361:0:1961:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00100000:2.0:1715205898.009365:0:1961:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131039880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0b65fb1-a2bf-4259-8680-142a231e8789:1961:1798523511138112:192.168.204.133@tcp:8:mount.lustre.0 00010000:00080000:2.0:1715205898.009379:0:1961:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=62166) req@ffff88013103a680 x1798523511138048/t0(0) o8->lustre-OST0000-osc-ffff8800a98fe800@192.168.204.133@tcp:28/4 lens 520/416 e 0 to 0 dl 1715205908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:2.0:1715205898.009391:0:1961:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8800a98fe800: committing for last_committed 0 gen 1 00000100:00080000:2.0:1715205898.009393:0:1961:0:(import.c:1087:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff8800a98fe800: connect to target with instance 1 00000100:00080000:2.0:1715205898.009397:0:1961:0:(import.c:940:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff8800a98fe800: Resetting ns_connect_flags to server flags: 0xa0425af2e3440078 00000080:00000004:2.0:1715205898.009399:0:1961:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1715205898.009401:0:1961:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1715205898.009402:0:1961:0:(import.c:1168:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1715205898.009404:0:1961:0:(import.c:86:import_set_state_nolock()) ffff8800b6761000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00020000:01000000:2.0:1715205898.009405:0:1961:0:(lov_obd.c:410:lov_set_osc_active()) Marking OSC lustre-OST0000_UUID active 00000080:00000004:2.0:1715205898.009407:0:1961:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1715205898.009408:0:1961:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00100000:2.0:1715205898.009411:0:1961:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d0b65fb1-a2bf-4259-8680-142a231e8789:1961:1798523511138048:192.168.204.133@tcp:8:mount.lustre.0 00000100:00100000:3.0:1715205898.009769:0:18931:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d0b65fb1-a2bf-4259-8680-142a231e8789:18931:1798523511138240:192.168.204.133@tcp:33:mount.lustre.0 00000080:00200000:3.0:1715205898.009806:0:18931:0:(llite_lib.c:3140:ll_read_inode2()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7780c8) 00000080:00200000:3.0:1715205898.009836:0:18931:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 11776 00000080:02000400:3.0:1715205898.009914:0:18931:0:(llite_lib.c:1512:ll_fill_super()) Mounted lustre-client 00000080:00000004:3.0:1715205898.011545:0:18931:0:(super25.c:192:lustre_fill_super()) 192.168.204.133@tcp:/lustre: Mount complete 00000001:02000400:3.0:1715205898.507525:0:19166:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg433-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1715205898.735959:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205899.737901:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205900.739953:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205901.741963:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205902.082638:0:19755:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1715205902.744014:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715205902.818944:0:1957:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.133@tcp (source: 12345-192.168.204.133@tcp) 00000100:00100000:3.0:1715205902.818998:0:1957:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.133@tcp (source: 12345-192.168.204.133@tcp) 00000100:00100000:2.0:1715205902.819017:0:4778:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516389376 00000100:00100000:2.0:1715205902.819027:0:4778:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516389376 00000100:00100000:2.0:1715205902.819120:0:4778:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523516389632 00000100:00100000:2.0:1715205902.819123:0:4778:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523516389632 00000100:00100000:2.0:1715205902.819138:0:4778:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.133@tcp, seq: 10 00000100:00100000:2.0:1715205902.819145:0:4778:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013103a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:614fb888-a54c-4440-9a2f-efd4f3a141dd+4:28664:x1798523516389376:12345-192.168.204.133@tcp:104: 00000100:00100000:3.0:1715205902.819148:0:8446:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.133@tcp, seq: 11 00000100:00100000:3.0:1715205902.819152:0:8446:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013103bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:614fb888-a54c-4440-9a2f-efd4f3a141dd+4:28664:x1798523516389632:12345-192.168.204.133@tcp:104: 00010000:00010000:3.0:1715205902.819159:0:8446:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205902.819159:0:4778:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205902.819222:0:8446:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1715205902.819228:0:8446:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013103bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:614fb888-a54c-4440-9a2f-efd4f3a141dd+4:28664:x1798523516389632:12345-192.168.204.133@tcp:104: Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205902.819235:0:8446:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.133@tcp, seq: 11 00010000:00010000:2.0:1715205902.819236:0:4778:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1715205902.819242:0:4778:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013103a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:614fb888-a54c-4440-9a2f-efd4f3a141dd+4:28664:x1798523516389376:12345-192.168.204.133@tcp:104: Request processed in 97us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205902.819248:0:4778:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.133@tcp, seq: 10 00010000:00010000:0.0:1715205902.819249:0:5285:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1715205902.819257:0:5285:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205902.819264:0:5285:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a81b00 already unused, calling callback (ffffffffa0af4a40) 10000000:00010000:0.0:1715205902.819268:0:5285:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205902.819272:0:16466:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715205902.819275:0:5285:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205902.819279:0:16466:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715205902.819282:0:5285:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205902.819285:0:16466:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa81680 already unused, calling callback (ffffffffa0af4a40) 10000000:01000000:0.0:1715205902.819286:0:5285:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:1.0:1715205902.819288:0:16466:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205902.819294:0:16466:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205902.819311:0:16466:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205902.819316:0:16466:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1715205902.819328:0:5285:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205902.819330:0:16466:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205902.819334:0:5285:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205902.819335:0:16466:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205902.819350:0:16466:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205902.819350:0:5285:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205902.819355:0:16466:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800aaa81680/0x361984fab9c06eb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345cb31 expref: -99 pid: 18931 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205902.819355:0:5285:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.133@tcp lock: ffff8800b0a81b00/0x361984fab9c06e5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa4db7398a345caf2 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205902.819367:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205902.819373:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205902.819373:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205902.819374:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205902.819375:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205902.819376:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205902.819388:0:1963:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511138304:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715205902.819389:0:1962:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511138368:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1715205902.820029:0:1963:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:614fb888-a54c-4440-9a2f-efd4f3a141dd:1963:1798523511138304:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715205902.820085:0:1962:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:614fb888-a54c-4440-9a2f-efd4f3a141dd:1962:1798523511138368:192.168.204.133@tcp:103:ldlm_bl.0 00000100:00080000:0.0:1715205903.015921:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715205903.015928:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) a48b4014-0bf7-40bf-a0c6-fdea296e6ca2->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715205903.016014:0:1962:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0b65fb1-a2bf-4259-8680-142a231e8789:1962:1798523511138496:192.168.204.133@tcp:400:kworker.0 00000100:00100000:1.0:1715205903.016017:0:1963:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0b65fb1-a2bf-4259-8680-142a231e8789:1963:1798523511138432:192.168.204.133@tcp:400:kworker.0 00000100:00100000:1.0:1715205903.016090:0:1963:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0b65fb1-a2bf-4259-8680-142a231e8789:1963:1798523511138560:192.168.204.133@tcp:400:kworker.0 00000100:00100000:1.0:1715205903.017286:0:1963:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0b65fb1-a2bf-4259-8680-142a231e8789:1963:1798523511138560:192.168.204.133@tcp:400:kworker.0 00000100:00100000:1.0:1715205903.017299:0:1963:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d0b65fb1-a2bf-4259-8680-142a231e8789:1963:1798523511138432:192.168.204.133@tcp:400:kworker.0 00010000:00080000:0.0:1715205903.017340:0:1962:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=62166) req@ffff8800adc33480 x1798523511138496/t0(0) o400->lustre-OST0000-osc-ffff8800a98fe800@192.168.204.133@tcp:28/4 lens 224/224 e 0 to 0 dl 1715205919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:0.0:1715205903.017355:0:1962:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d0b65fb1-a2bf-4259-8680-142a231e8789:1962:1798523511138496:192.168.204.133@tcp:400:kworker.0 00000080:00200000:0.0:1715205903.399187:0:18302:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205903.399203:0:18302:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205903.399239:0:18302:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399246:0:18302:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399253:0:18302:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00000100:00100000:0.0:1715205903.399265:0:18302:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b0803c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205903.399273:0:18302:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:18302:1798523511138624:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205903.399279:0:18302:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399283:0:18302:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399289:0:18302:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399293:0:18302:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399296:0:18302:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399299:0:18302:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa833c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205903.399301:0:18302:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399304:0:18302:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399307:0:18302:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399310:0:18302:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205903.399313:0:18302:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399316:0:18302:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa833c0/0x361984fab9c06eda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00000080:00020000:0.0:1715205903.399327:0:18302:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205903.399339:0:18302:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:0.0:1715205903.399342:0:18302:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205903.399351:0:18302:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399358:0:18302:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399362:0:18302:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00000100:00100000:0.0:1715205903.399366:0:18302:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b0803c0 going to sleep for 0 seconds 00000100:00100000:0.0:1715205903.399368:0:18302:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:18302:1798523511138688:192.168.204.133@tcp:101:bash.0 00010000:00010000:0.0:1715205903.399371:0:18302:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399374:0:18302:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399376:0:18302:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399379:0:18302:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399381:0:18302:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399384:0:18302:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aaa83180 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:0.0:1715205903.399385:0:18302:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399387:0:18302:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399390:0:18302:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399396:0:18302:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205903.399397:0:18302:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00010000:00010000:0.0:1715205903.399400:0:18302:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800aaa83180/0x361984fab9c06ee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18302 initiator: MDT0 00000080:00020000:0.0:1715205903.399406:0:18302:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205903.401308:0:20064:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205903.401318:0:20064:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205903.401341:0:20064:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401348:0:20064:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401355:0:20064:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00000100:00100000:1.0:1715205903.401363:0:20064:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851a80 going to sleep for 0 seconds 00000100:00100000:1.0:1715205903.401369:0:20064:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20064:1798523511138752:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205903.401375:0:20064:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401380:0:20064:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401385:0:20064:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401389:0:20064:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401393:0:20064:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401397:0:20064:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a2d00 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205903.401399:0:20064:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401403:0:20064:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401407:0:20064:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401414:0:20064:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205903.401417:0:20064:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401422:0:20064:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2d00/0x361984fab9c06ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00000080:00020000:1.0:1715205903.401433:0:20064:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205903.401458:0:20064:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205903.401463:0:20064:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205903.401473:0:20064:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401478:0:20064:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401482:0:20064:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00000100:00100000:1.0:1715205903.401488:0:20064:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851a80 going to sleep for 0 seconds 00000100:00100000:1.0:1715205903.401492:0:20064:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20064:1798523511138816:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205903.401496:0:20064:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401500:0:20064:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401504:0:20064:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401508:0:20064:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401516:0:20064:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401520:0:20064:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a2f40 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205903.401522:0:20064:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401527:0:20064:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401531:0:20064:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401534:0:20064:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205903.401537:0:20064:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401540:0:20064:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a2f40/0x361984fab9c06eef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00000080:00020000:1.0:1715205903.401555:0:20064:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205903.401778:0:20064:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205903.401784:0:20064:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205903.401797:0:20064:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401802:0:20064:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401807:0:20064:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00000100:00100000:1.0:1715205903.401829:0:20064:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851a80 going to sleep for 0 seconds 00000100:00100000:1.0:1715205903.401836:0:20064:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20064:1798523511138880:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205903.401841:0:20064:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401846:0:20064:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401850:0:20064:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401854:0:20064:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401858:0:20064:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401861:0:20064:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a3180 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205903.401863:0:20064:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401867:0:20064:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401871:0:20064:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401875:0:20064:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205903.401877:0:20064:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401880:0:20064:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3180/0x361984fab9c06ef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00000080:00020000:1.0:1715205903.401890:0:20064:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205903.401900:0:20064:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205903.401904:0:20064:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205903.401915:0:20064:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401919:0:20064:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401924:0:20064:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00000100:00100000:1.0:1715205903.401929:0:20064:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851a80 going to sleep for 0 seconds 00000100:00100000:1.0:1715205903.401932:0:20064:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20064:1798523511138944:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205903.401936:0:20064:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401940:0:20064:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401944:0:20064:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401948:0:20064:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401952:0:20064:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401956:0:20064:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a33c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205903.401958:0:20064:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401961:0:20064:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401968:0:20064:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401972:0:20064:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205903.401974:0:20064:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.401978:0:20064:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a33c0/0x361984fab9c06efd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00000080:00020000:1.0:1715205903.401986:0:20064:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205903.402020:0:20064:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205903.402025:0:20064:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205903.402036:0:20064:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402040:0:20064:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402045:0:20064:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00000100:00100000:1.0:1715205903.402050:0:20064:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851a80 going to sleep for 0 seconds 00000100:00100000:1.0:1715205903.402054:0:20064:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20064:1798523511139008:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205903.402058:0:20064:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402062:0:20064:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402066:0:20064:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402073:0:20064:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402078:0:20064:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402081:0:20064:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a3600 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205903.402083:0:20064:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402087:0:20064:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402091:0:20064:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402094:0:20064:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205903.402096:0:20064:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402101:0:20064:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3600/0x361984fab9c06f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00000080:00020000:1.0:1715205903.402109:0:20064:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205903.402115:0:20064:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:1.0:1715205903.402118:0:20064:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205903.402126:0:20064:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402131:0:20064:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402135:0:20064:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00000100:00100000:1.0:1715205903.402144:0:20064:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012f851a80 going to sleep for 0 seconds 00000100:00100000:1.0:1715205903.402148:0:20064:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b1ef800 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20064:1798523511139072:192.168.204.133@tcp:101:rm.0 00010000:00010000:1.0:1715205903.402152:0:20064:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402156:0:20064:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402160:0:20064:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402164:0:20064:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402168:0:20064:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402171:0:20064:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac1a3cc0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:1.0:1715205903.402173:0:20064:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402177:0:20064:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402181:0:20064:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402184:0:20064:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205903.402186:0:20064:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00010000:00010000:1.0:1715205903.402190:0:20064:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800ac1a3cc0/0x361984fab9c06f0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20064 initiator: MDT0 00000080:00020000:1.0:1715205903.402200:0:20064:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:1.0:1715205903.746397:0:4787:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1715205904.295917:0:4789:0:(mgc_request.c:626:do_requeue()) updating log params 10000000:01000000:2.0:1715205904.295924:0:4789:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff8800a98fe800 from 10 10000000:01000000:2.0:1715205904.295928:0:4789:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1715205904.295982:0:4789:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81d40/0x361984fab9c06f12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205904.295990:0:4789:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff8800b0a81d40/0x361984fab9c06f12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205904.295997:0:4789:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff8800b0a81d40/0x361984fab9c06f12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205904.296020:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139136:192.168.204.133@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.296090:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1715205904.297271:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139136:192.168.204.133@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715205904.297284:0:4789:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff8800b0a81d40/0x361984fab9c06f12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb54 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205904.297291:0:4789:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff8800b0a81d40/0x361984fab9c06f12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345cb54 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205904.297331:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139200:192.168.204.133@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.297353:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1715205904.298222:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139200:192.168.204.133@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.298244:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139264:192.168.204.133@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.298279:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1715205904.299129:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139264:192.168.204.133@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715205904.299325:0:20481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013103aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20481:1798523511139328:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715205904.299369:0:20481:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989a480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205904.300190:0:20481:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20481:1798523511139328:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:0.0:1715205904.300215:0:20481:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1715205904.300222:0:20481:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205904.300223:0:20481:0:(obd_config.c:1497:class_process_config()) marker 5 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1715205904.300227:0:20481:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff8800a98fe800 00000020:00000080:0.0:1715205904.300228:0:20481:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1715205904.300281:0:20481:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20481:1798523511139392:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:0.0:1715205904.300309:0:20481:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b080b40 going to sleep for 11 seconds 00000100:00100000:0.0:1715205904.301664:0:20481:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20481:1798523511139392:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:0.0:1715205904.301692:0:20481:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1715205904.301697:0:20481:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205904.301698:0:20481:0:(obd_config.c:1497:class_process_config()) marker 5 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1715205904.301702:0:20481:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1715205904.301754:0:4789:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1715205904.301774:0:4789:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1715205904.301782:0:4789:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81d40/0x361984fab9c06f12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb54 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205904.301797:0:4789:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff8800b0a81d40/0x361984fab9c06f12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb54 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715205904.301806:0:4789:0:(mgc_request.c:626:do_requeue()) updating log params 10000000:01000000:2.0:1715205904.301808:0:4789:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff880136899800 from 10 10000000:01000000:2.0:1715205904.301828:0:4789:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1715205904.301848:0:4789:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205904.301855:0:4789:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205904.301862:0:4789:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205904.301874:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139456:192.168.204.133@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.301908:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1715205904.302617:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139456:192.168.204.133@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715205904.302628:0:4789:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205904.302635:0:4789:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205904.302660:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139520:192.168.204.133@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.302691:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1715205904.303254:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139520:192.168.204.133@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.303277:0:4789:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139584:192.168.204.133@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715205904.303308:0:4789:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3840 going to sleep for 11 seconds 00000100:00100000:2.0:1715205904.304033:0:4789:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:614fb888-a54c-4440-9a2f-efd4f3a141dd:4789:1798523511139584:192.168.204.133@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715205904.304204:0:20484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013103b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20484:1798523511139648:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715205904.304231:0:20484:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989a480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205904.304962:0:20484:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20484:1798523511139648:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:0.0:1715205904.304982:0:20484:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1715205904.304987:0:20484:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205904.304988:0:20484:0:(obd_config.c:1497:class_process_config()) marker 5 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1715205904.304991:0:20484:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff880136899800 00000020:00000080:0.0:1715205904.304993:0:20484:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1715205904.305031:0:20484:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20484:1798523511139712:192.168.204.133@tcp:502:llog_process_th.0 00000100:00100000:0.0:1715205904.305053:0:20484:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b080b40 going to sleep for 11 seconds 00000100:00100000:1.0:1715205904.305966:0:20484:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800adc33480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:614fb888-a54c-4440-9a2f-efd4f3a141dd:20484:1798523511139712:192.168.204.133@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205904.305986:0:20484:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205904.305989:0:20484:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205904.305991:0:20484:0:(obd_config.c:1497:class_process_config()) marker 5 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1715205904.305994:0:20484:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1715205904.306059:0:4789:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1715205904.306075:0:4789:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.133@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1715205904.306082:0:4789:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205904.306093:0:4789:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.133@tcp lock: ffff8800b0a81f80/0x361984fab9c06f19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa4db7398a345cb5b expref: -99 pid: 4789 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205904.747963:0:5285:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205905.185154:0:20705:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test complete, duration 170 sec ============ 18:05:04 (1715205904) 00000080:00200000:2.0:1715205905.226046:0:6866:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:2.0:1715205905.226063:0:6866:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205905.226099:0:6866:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226106:0:6866:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226113:0:6866:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6866 initiator: MDT0 00000100:00100000:2.0:1715205905.226127:0:6866:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dba3b40 going to sleep for 0 seconds 00000100:00100000:2.0:1715205905.226136:0:6866:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa865180 pname:cluuid:pid:xid:nid:opc:job bash:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:6866:1798523511139776:192.168.204.133@tcp:101:bash.0 00010000:00010000:2.0:1715205905.226144:0:6866:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226148:0:6866:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226152:0:6866:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226156:0:6866:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226161:0:6866:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226174:0:6866:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a821c0 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:2.0:1715205905.226177:0:6866:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226181:0:6866:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226186:0:6866:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226191:0:6866:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715205905.226195:0:6866:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 6866 initiator: MDT0 00010000:00010000:2.0:1715205905.226198:0:6866:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a821c0/0x361984fab9c06f20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 6866 initiator: MDT0 00000080:00020000:2.0:1715205905.226213:0:6866:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715205905.227617:0:20737:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:3.0:1715205905.227624:0:20737:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205905.227638:0:20737:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227641:0:20737:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227644:0:20737:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20737 initiator: MDT0 00000100:00100000:3.0:1715205905.227661:0:20737:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989ac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715205905.227664:0:20737:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103b100 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20737:1798523511139840:192.168.204.133@tcp:101:rm.0 00010000:00010000:3.0:1715205905.227668:0:20737:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227671:0:20737:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227673:0:20737:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227675:0:20737:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227678:0:20737:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227680:0:20737:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a3df80 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:3.0:1715205905.227684:0:20737:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227686:0:20737:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227689:0:20737:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227691:0:20737:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205905.227692:0:20737:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227695:0:20737:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3df80/0x361984fab9c06f27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20737 initiator: MDT0 00000080:00020000:3.0:1715205905.227703:0:20737:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715205905.227724:0:20737:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012e7400c8),name=/ 00000002:00010000:3.0:1715205905.227728:0:20737:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205905.227736:0:20737:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227739:0:20737:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227742:0:20737:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20737 initiator: MDT0 00000100:00100000:3.0:1715205905.227746:0:20737:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a989ac00 going to sleep for 0 seconds 00000100:00100000:3.0:1715205905.227748:0:20737:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013103b100 pname:cluuid:pid:xid:nid:opc:job rm:a48b4014-0bf7-40bf-a0c6-fdea296e6ca2:20737:1798523511139904:192.168.204.133@tcp:101:rm.0 00010000:00010000:3.0:1715205905.227750:0:20737:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227753:0:20737:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227758:0:20737:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227760:0:20737:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227762:0:20737:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227764:0:20737:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800b0a3dd40 already unused, calling callback (ffffffffa1006e10) 00010000:00010000:3.0:1715205905.227765:0:20737:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227767:0:20737:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227769:0:20737:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227771:0:20737:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205905.227772:0:20737:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20737 initiator: MDT0 00010000:00010000:3.0:1715205905.227774:0:20737:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff880136899800 lock: ffff8800b0a3dd40/0x361984fab9c06f2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20737 initiator: MDT0 00000080:00020000:3.0:1715205905.227780:0:20737:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000001:02000400:3.0:1715205905.524683:0:20868:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-dom : @@@@@@ FAIL: remove sub-test dirs failed 00010000:00010000:0.0:1715205905.749891:0:16466:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1374 lines, 1374 kept, 0 dropped, 0 bad.