00010000:00010000:1.0F:1715205894.768115:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1715205895.769959:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0F:1715205896.143921:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715205896.143942:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0F:1715205896.143952:0:2006:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2006:1798523513236224:192.168.204.135@tcp:400:kworker.0 00000100:00100000:2.0:1715205896.143980:0:2007:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4f93b71f-777f-44ae-ae8f-53d858e20398:2007:1798523513236288:192.168.204.135@tcp:400:kworker.0 00000100:00100000:2.0:1715205896.144013:0:2007:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ae639000-c6e7-4dd4-9269-d2ba3337aea4:2007:1798523513236416:192.168.204.135@tcp:400:kworker.0 00000100:00100000:3.0:1715205896.144022:0:2006:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ae639000-c6e7-4dd4-9269-d2ba3337aea4:2006:1798523513236352:192.168.204.135@tcp:400:kworker.0 00000100:00100000:3.0:1715205896.144989:0:2006:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa936680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2006:1798523513236224:192.168.204.135@tcp:400:kworker.0 00010000:00080000:2.0:1715205896.144992:0:2007:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa934000 x1798523513236288/t0(0) o400->lustre-MDT0001-mdc-ffff8800b3e33000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:2.0:1715205896.145001:0:2007:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:4f93b71f-777f-44ae-ae8f-53d858e20398:2007:1798523513236288:192.168.204.135@tcp:400:kworker.0 00010000:00080000:2.0:1715205896.145007:0:2007:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa936300 x1798523513236416/t0(0) o400->lustre-MDT0001-mdc-ffff8800a9ca3000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:3.0:1715205896.145009:0:2006:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ae639000-c6e7-4dd4-9269-d2ba3337aea4:2006:1798523513236352:192.168.204.135@tcp:400:kworker.0 00000100:00100000:2.0:1715205896.145012:0:2007:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ae639000-c6e7-4dd4-9269-d2ba3337aea4:2007:1798523513236416:192.168.204.135@tcp:400:kworker.0 00010000:00010000:1.0:1715205896.771875:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205896.868717:0:15960:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test sanity: Run sanity with Data-on-MDT files ========================================================== 18:04:56 (1715205896) 00010000:00010000:0.0:1715205897.773881:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205898.776010:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205899.777991:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205900.224708:0:16415:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 42a 42c 42b 118c 118d 407 411b 00000001:02000400:3.0:1715205900.540460:0:16569:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 27m 60i 64b 68 71 135 136 230d 300o 842 00000080:00200008:1.0:1715205900.570531:0:15978:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205900.570537:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205900.570554:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205900.570644:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570650:0:15978:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570656:0:15978:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00000100:00100000:1.0:1715205900.570667:0:15978:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f6c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715205900.570675:0:15978:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028a80 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:15978:1798523513236480:192.168.204.135@tcp:101:bash.0 00010000:00010000:1.0:1715205900.570682:0:15978:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570685:0:15978:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570688:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570693:0:15978:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570698:0:15978:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570704:0:15978:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa933600 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205900.570707:0:15978:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570716:0:15978:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570721:0:15978:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570727:0:15978:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205900.570731:0:15978:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.570736:0:15978:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933600/0x68b86d4dd46f4f3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00000080:00020000:1.0:1715205900.570753:0:15978:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715205900.575008:0:15978:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205900.575012:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205900.575022:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205900.575042:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575047:0:15978:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575051:0:15978:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00000100:00100000:1.0:1715205900.575058:0:15978:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f6c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715205900.575062:0:15978:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028a80 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:15978:1798523513236544:192.168.204.135@tcp:101:bash.0 00010000:00010000:1.0:1715205900.575067:0:15978:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575070:0:15978:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575078:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575081:0:15978:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575084:0:15978:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575087:0:15978:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa9333c0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205900.575089:0:15978:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575091:0:15978:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575094:0:15978:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575096:0:15978:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205900.575098:0:15978:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.575101:0:15978:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa9333c0/0x68b86d4dd46f4f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00000080:00020000:1.0:1715205900.575112:0:15978:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715205900.575151:0:15978:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012f2680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205900.575153:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012f2680c8),name=/ 00000002:00010000:1.0:1715205900.575160:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205900.575167:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.575175:0:15978:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715205900.575180:0:15978:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) 00000080:00010000:1.0:1715205900.575182:0:15978:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) for lock 0x68b86d4dd46f4f1b 00000080:00010000:1.0:1715205900.575186:0:15978:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x68b86d4dd46f4f1b from it ffff88012d7f3cc8 00010000:00010000:1.0:1715205900.575187:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.575191:0:15978:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715205900.579744:0:15978:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205900.579749:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205900.579761:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205900.579789:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579794:0:15978:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579798:0:15978:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00000100:00100000:1.0:1715205900.579824:0:15978:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f6c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715205900.579830:0:15978:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028a80 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:15978:1798523513236608:192.168.204.135@tcp:101:bash.0 00010000:00010000:1.0:1715205900.579835:0:15978:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579845:0:15978:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579848:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579851:0:15978:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579854:0:15978:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579857:0:15978:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa933840 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205900.579859:0:15978:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579861:0:15978:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579864:0:15978:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579868:0:15978:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205900.579870:0:15978:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579873:0:15978:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933840/0x68b86d4dd46f4f4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00000080:00020000:1.0:1715205900.579884:0:15978:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715205900.579920:0:15978:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205900.579922:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205900.579929:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205900.579939:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579942:0:15978:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579945:0:15978:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00000100:00100000:1.0:1715205900.579950:0:15978:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f6c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715205900.579952:0:15978:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028a80 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:15978:1798523513236672:192.168.204.135@tcp:101:bash.0 00010000:00010000:1.0:1715205900.579956:0:15978:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579958:0:15978:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579961:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579963:0:15978:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579966:0:15978:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579968:0:15978:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa933cc0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205900.579969:0:15978:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579972:0:15978:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579978:0:15978:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579980:0:15978:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205900.579982:0:15978:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00010000:00010000:1.0:1715205900.579984:0:15978:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933cc0/0x68b86d4dd46f4f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00000080:00020000:1.0:1715205900.579991:0:15978:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715205900.580030:0:15978:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012f2680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715205900.580033:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012f2680c8),name=/ 00000002:00010000:1.0:1715205900.580039:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205900.580045:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.580050:0:15978:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715205900.580055:0:15978:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) 00000080:00010000:1.0:1715205900.580056:0:15978:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) for lock 0x68b86d4dd46f4f1b 00000080:00010000:1.0:1715205900.580059:0:15978:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x68b86d4dd46f4f1b from it ffff88012d7f3cc8 00010000:00010000:1.0:1715205900.580060:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.580064:0:15978:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715205900.629093:0:16621:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715205900.629102:0:16621:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:3.0:1715205900.629119:0:16621:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205900.629172:0:16621:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629181:0:16621:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629191:0:16621:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16621 initiator: MDT0 00000100:00100000:3.0:1715205900.629209:0:16621:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfabf00 going to sleep for 0 seconds 00000100:00100000:3.0:1715205900.629221:0:16621:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job lsof:4f93b71f-777f-44ae-ae8f-53d858e20398:16621:1798523513236736:192.168.204.135@tcp:101:lsof.0 00010000:00010000:3.0:1715205900.629230:0:16621:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629236:0:16621:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629241:0:16621:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629252:0:16621:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629258:0:16621:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629263:0:16621:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa95ef40 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:3.0:1715205900.629267:0:16621:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629273:0:16621:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629280:0:16621:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629284:0:16621:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205900.629289:0:16621:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16621 initiator: MDT0 00010000:00010000:3.0:1715205900.629293:0:16621:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95ef40/0x68b86d4dd46f4f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 16621 initiator: MDT0 00000080:00020000:3.0:1715205900.629322:0:16621:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715205900.629564:0:16621:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012f2680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205900.629571:0:16621:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012f2680c8),name=/ 00000002:00010000:0.0:1715205900.629596:0:16621:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205900.629608:0:16621:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205900.629617:0:16621:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1715205900.629624:0:16621:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) 00000080:00010000:0.0:1715205900.629626:0:16621:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) for lock 0x68b86d4dd46f4f1b 00000080:00010000:0.0:1715205900.629630:0:16621:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x68b86d4dd46f4f1b from it ffff8800a9f0bcc8 00010000:00010000:0.0:1715205900.629633:0:16621:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205900.629637:0:16621:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715205900.702717:0:16622:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff88012f2680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715205900.702722:0:16622:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012f2680c8),name=/ 00000002:00010000:3.0:1715205900.702738:0:16622:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205900.702750:0:16622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.702759:0:16622:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715205900.702769:0:16622:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) 00000080:00010000:3.0:1715205900.702771:0:16622:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff88012f2680c8) for lock 0x68b86d4dd46f4f1b 00000080:00010000:3.0:1715205900.702776:0:16622:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x68b86d4dd46f4f1b from it ffff88012ab73cc8 00010000:00010000:3.0:1715205900.702778:0:16622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.702782:0:16622:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715205900.714131:0:65:0:(vvp_io.c:1871:vvp_io_init()) [0x200000403:0x1:0x0] ignore/verify layout 1/0, layout version 2 restore needed 0 00020000:00200000:2.0:1715205900.714142:0:65:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1715205900.714149:0:65:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:2.0:1715205900.714161:0:65:0:(vvp_io.c:304:vvp_io_fini()) [0x200000403:0x1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:2.0:1715205900.714199:0:65:0:(vvp_io.c:1871:vvp_io_init()) [0x200000403:0x1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:2.0:1715205900.714202:0:65:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:2.0:1715205900.714205:0:65:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000008:00010000:2.0:1715205900.714215:0:65:0:(osc_cache.c:1842:try_to_add_extent_for_io()) ### extent: ffff8800b3e8d000 ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00000008:00010000:2.0:1715205900.714229:0:65:0:(osc_cache.c:1089:osc_extent_make_ready()) ### extent: ffff8800b3e8d000 ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1715205900.714263:0:65:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00000008:00100000:2.0:1715205900.714354:0:65:0:(osc_request.c:1963:osc_brw_prep_request()) brw rpc ffff8800aa936300 - object 0x200000403:1 offset 0<>1000 00000100:00100000:2.0:1715205900.714388:0:2007:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715205900.714403:0:2007:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ae639000-c6e7-4dd4-9269-d2ba3337aea4:2007:1798523513236800:192.168.204.135@tcp:4:md5sum.0 00000100:00100000:3.0:1715205900.715949:0:2007:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9ca3000: committing for last_committed 4294967319 gen 1 00000100:00100000:3.0:1715205900.715968:0:2007:0:(client.c:3005:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff8800aa02bb80 x1798523513235712/t4294967319(4294967319) o101->lustre-MDT0000-mdc-ffff8800a9ca3000@192.168.204.135@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205906 ref 1 fl Complete:RPQU/204/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 00000100:00100000:3.0:1715205900.715976:0:2007:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff8800aa936300 x1798523513236800/t4294967320(4294967320) o4->lustre-MDT0000-mdc-ffff8800a9ca3000@192.168.204.135@tcp:13/10 lens 1488/448 e 0 to 0 dl 1715205916 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 00000008:00010000:3.0:1715205900.715998:0:2007:0:(osc_cache.c:845:osc_extent_finish()) ### extent: ffff8800b3e8d000 ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00000008:00010000:3.0:1715205900.716018:0:2007:0:(osc_cache.c:504:__osc_extent_remove()) ### extent: ffff8800b3e8d000 ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1715205900.716026:0:2007:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa936300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ae639000-c6e7-4dd4-9269-d2ba3337aea4:2007:1798523513236800:192.168.204.135@tcp:4:md5sum.0 00000080:00200000:2.0:1715205900.716043:0:65:0:(vvp_io.c:304:vvp_io_fini()) [0x200000403:0x1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1715205900.716067:0:16622:0:(llite_lib.c:1925:ll_clear_inode()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012f2680c8) 00000080:00200000:3.0:1715205900.716102:0:16622:0:(vvp_io.c:1871:vvp_io_init()) [0x200000402:0x3:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1715205900.716115:0:16622:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1715205900.716126:0:16622:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1715205900.716131:0:16622:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x3:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1715205900.716137:0:16622:0:(llite_lib.c:1925:ll_clear_inode()) VFS Op:inode=[0x200000402:0x3:0x0](ffff8800b0a988c8) 00000080:00200000:3.0:1715205900.716196:0:16622:0:(vvp_io.c:1871:vvp_io_init()) [0x200000403:0x1:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0 00020000:00200000:3.0:1715205900.716201:0:16622:0:(lov_io.c:867:lov_io_iter_init()) component[0] flags 0x10 00020000:00200000:3.0:1715205900.716203:0:16622:0:(lov_io.c:867:lov_io_iter_init()) component[1] flags 0x0 00000080:00200000:3.0:1715205900.716207:0:16622:0:(vvp_io.c:304:vvp_io_fini()) [0x200000403:0x1:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0 00000080:00200000:3.0:1715205900.716229:0:16622:0:(llite_lib.c:1925:ll_clear_inode()) VFS Op:inode=[0x200000403:0x1:0x0](ffff88012f2688c8) 00000002:00100000:3.0:1715205900.716250:0:16622:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800aa02bb80 x1798523513235712/t4294967319(4294967319) o101->lustre-MDT0000-mdc-ffff8800a9ca3000@192.168.204.135@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205906 ref 1 fl Complete:RPQU/204/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 00000020:00100000:3.0:1715205900.716265:0:16622:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9ca3000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1715205900.716269:0:16622:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012d7e7480 x1798523513236928/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9ca3000@192.168.204.135@tcp:23/10 lens 392/712 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715205900.716283:0:16622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513236928:192.168.204.135@tcp:35:umount.0 00000100:00100000:3.0:1715205900.716315:0:16622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfab480 going to sleep for 11 seconds 00000100:00100000:3.0:1715205900.717015:0:16622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513236928:192.168.204.135@tcp:35:umount.0 00000002:00100000:3.0:1715205900.717030:0:16622:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800aa02bb80 x1798523513235712/t4294967319(4294967319) o101->lustre-MDT0000-mdc-ffff8800a9ca3000@192.168.204.135@tcp:12/10 lens 736/824 e 0 to 0 dl 1715205906 ref 1 fl Complete:RQU/204/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 00000002:00010000:3.0:1715205900.717051:0:16622:0:(mdc_dev.c:1493:mdc_object_ast_clear()) ### update lock size 0 blocks 0 [cma]time: 1715205890 1715205890 1715205890 by oinfo size 1000 blocks 8 [cma]time 1715205890 1715205890 1715205890 ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 1/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x800020000000000 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00000080:00200000:3.0:1715205900.717073:0:16622:0:(llite_lib.c:1551:ll_put_super()) VFS Op: cfg_instance lustre-client-ffff8800a9ca3000 (sb ffff8800a9ca3000) 00010000:00010000:3.0:1715205900.717086:0:16622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717093:0:16622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717105:0:16622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717111:0:16622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717130:0:16622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1715205900.717134:0:16622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717140:0:16622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717145:0:16622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717150:0:16622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717156:0:5365:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715205900.717161:0:16622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715205900.717164:0:5365:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717166:0:16622:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717168:0:5365:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa930480 already unused, calling callback (ffffffffa04cea40) 00010000:00010000:3.0:1715205900.717171:0:16622:0:(ldlm_lock.c:971:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205900.717171:0:5365:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717175:0:16622:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717175:0:5365:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205900.717179:0:5365:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.717180:0:16622:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205900.717181:0:5365:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1715205900.717182:0:5365:0:(mgc_request.c:940:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1715205900.717188:0:5876:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205900.717190:0:16622:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1715205900.717193:0:16622:0:(mgc_request.c:150:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1715205900.717195:0:5365:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715205900.717196:0:16622:0:(mgc_request.c:562:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1715205900.717198:0:5365:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205900.717209:0:5365:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717212:0:5365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff8800aa930480/0x68b86d4dd46f4b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a9778111c7 expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717220:0:5365:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205900.717221:0:5365:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205900.717222:0:2005:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2005:1798523513236992:192.168.204.135@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715205900.717224:0:5365:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa964b40 already unused, calling callback (ffffffffa04cea40) 10000000:00010000:1.0:1715205900.717226:0:5365:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717233:0:5365:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205900.717236:0:5365:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205900.717238:0:5365:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1715205900.717239:0:5365:0:(mgc_request.c:940:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1715205900.717240:0:5365:0:(mgc_request.c:150:config_log_put()) dropping config log params 00010000:00010000:1.0:1715205900.717246:0:5365:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717248:0:5365:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205900.717251:0:5365:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205900.717253:0:2005:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1715205900.717254:0:5365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff8800aa964b40/0x68b86d4dd46f4bbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a977811387 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205900.717258:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205900.717258:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205900.717258:0:2005:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2005:1798523513237056:192.168.204.135@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715205900.717259:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205900.717306:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205900.717307:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205900.717308:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205900.717314:0:5876:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205900.717321:0:5876:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa964900 already unused, calling callback (ffffffffa04cea40) 10000000:00010000:0.0:1715205900.717329:0:5876:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205900.717335:0:5876:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715205900.717340:0:5876:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715205900.717344:0:5876:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1715205900.717346:0:5876:0:(mgc_request.c:940:mgc_blocking_ast()) log lustre-cliir: stopping, won't requeue 10000000:01000000:0.0:1715205900.717347:0:5876:0:(mgc_request.c:150:config_log_put()) dropping config log lustre-cliir 00010000:00010000:0.0:1715205900.717359:0:5876:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00020000:01000000:3.0:1715205900.717364:0:16622:0:(lov_obd.c:637:lov_del_target()) uuid: lustre-OST0000_UUID idx: 0 gen: 1 exp: ffff8800a9d1f000 active: 1 00010000:00010000:0.0:1715205900.717364:0:5876:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00020000:01000000:3.0:1715205900.717366:0:16622:0:(lov_obd.c:637:lov_del_target()) uuid: lustre-OST0001_UUID idx: 1 gen: 1 exp: ffff8800a9d1e000 active: 1 00020000:01000000:3.0:1715205900.717367:0:16622:0:(lov_obd.c:84:lov_tgts_putref()) destroying 2 lov targets 00020000:01000000:3.0:1715205900.717369:0:16622:0:(lov_obd.c:659:__lov_del_obd()) Removing tgt lustre-OST0001_UUID : lustre-OST0001-osc-ffff8800a9ca3000 00020000:01000000:3.0:1715205900.717370:0:16622:0:(lov_obd.c:268:lov_disconnect_obd()) lustre-clilov-ffff8800a9ca3000: disconnecting target lustre-OST0001-osc-ffff8800a9ca3000 00000100:00080000:3.0:1715205900.717379:0:16622:0:(pinger.c:420:ptlrpc_pinger_del_import()) removing pingable import ae639000-c6e7-4dd4-9269-d2ba3337aea4->lustre-OST0001_UUID 00010000:00010000:0.0:1715205900.717379:0:5876:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205900.717385:0:5876:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff8800aa964900/0x68b86d4dd46f4b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4cb6a6a9778111ce expref: -99 pid: 7979 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205900.717391:0:2004:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1715205900.717395:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205900.717396:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205900.717398:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205900.717400:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513237120:192.168.204.135@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1715205900.717433:0:16622:0:(import.c:86:import_set_state_nolock()) ffff8800a9ca7800 lustre-OST0001_UUID: changing import state from IDLE to CLOSED 00000100:00080000:3.0:1715205900.717436:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1715205900.717438:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8800a9ca3000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1715205900.717439:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1715205900.717512:0:16622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x68b86d4dd46f4b63 00000020:00000080:3.0:1715205900.717518:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9d1e000/LOV_OSC_UUID 00000020:00000080:2.0:1715205900.717532:0:65:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9d1e000/LOV_OSC_UUID for lustre-OST0001-osc-ffff8800a9ca3000 00000020:01000000:3.0:1715205900.717535:0:16622:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-ffff8800a9ca3000 (flags='') 00000020:00000080:3.0:1715205900.717537:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1715205900.717543:0:16622:0:(obd_config.c:900:class_cleanup()) lustre-OST0001-osc-ffff8800a9ca3000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1715205900.717545:0:16622:0:(genops.c:1485:class_disconnect_exports()) OBD device 12 (ffff8800a9c8ea90) has no exports 00000008:01000000:3.0:1715205900.717564:0:16622:0:(obd_class.h:698:obd_cleanup_client_import()) lustre-OST0001-osc-ffff8800a9ca3000: client import never connected 00000100:00080000:3.0:1715205900.717565:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1715205900.717567:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8800a9ca3000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1715205900.717568:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1715205900.717675:0:65:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff8800a9ca7800 for lustre-OST0001-osc-ffff8800a9ca3000 00000020:00000080:3.0:1715205900.717736:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1715205900.717743:0:16622:0:(obd_config.c:828:class_detach()) detach on obd lustre-OST0001-osc-ffff8800a9ca3000 (uuid ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:00000080:3.0:1715205900.717745:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9ca7000/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:3.0:1715205900.717747:0:16622:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9ca7000/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-OST0001-osc-ffff8800a9ca3000 00000020:01000000:3.0:1715205900.717750:0:16622:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-ffff8800a9ca3000 (ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00020000:01000000:3.0:1715205900.717864:0:16622:0:(lov_obd.c:659:__lov_del_obd()) Removing tgt lustre-OST0000_UUID : lustre-OST0000-osc-ffff8800a9ca3000 00020000:01000000:3.0:1715205900.717865:0:16622:0:(lov_obd.c:268:lov_disconnect_obd()) lustre-clilov-ffff8800a9ca3000: disconnecting target lustre-OST0000-osc-ffff8800a9ca3000 00000100:00080000:3.0:1715205900.717869:0:16622:0:(pinger.c:420:ptlrpc_pinger_del_import()) removing pingable import ae639000-c6e7-4dd4-9269-d2ba3337aea4->lustre-OST0000_UUID 00000100:00100000:0.0:1715205900.717869:0:2005:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2005:1798523513237056:192.168.204.135@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1715205900.717874:0:2005:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2005:1798523513236992:192.168.204.135@tcp:103:ldlm_bl.0 00000100:00080000:3.0:1715205900.717921:0:16622:0:(import.c:86:import_set_state_nolock()) ffff8800a9ca6800 lustre-OST0000_UUID: changing import state from IDLE to CLOSED 00000100:00080000:3.0:1715205900.717924:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1715205900.717925:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8800a9ca3000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1715205900.717926:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1715205900.717934:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513237120:192.168.204.135@tcp:103:ldlm_bl.0 00000020:00000080:3.0:1715205900.717997:0:16622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x68b86d4dd46f4b5c 00000020:00000080:3.0:1715205900.718001:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9d1f000/LOV_OSC_UUID 00000020:00000080:2.0:1715205900.718013:0:65:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9d1f000/LOV_OSC_UUID for lustre-OST0000-osc-ffff8800a9ca3000 00000020:01000000:3.0:1715205900.718014:0:16622:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-ffff8800a9ca3000 (flags='') 00000020:00000080:3.0:1715205900.718015:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1715205900.718018:0:16622:0:(obd_config.c:900:class_cleanup()) lustre-OST0000-osc-ffff8800a9ca3000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1715205900.718019:0:16622:0:(genops.c:1485:class_disconnect_exports()) OBD device 11 (ffff8800a9c8d540) has no exports 00000008:01000000:3.0:1715205900.718029:0:16622:0:(obd_class.h:698:obd_cleanup_client_import()) lustre-OST0000-osc-ffff8800a9ca3000: client import never connected 00000100:00080000:3.0:1715205900.718030:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1715205900.718031:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8800a9ca3000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1715205900.718032:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1715205900.718114:0:65:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff8800a9ca6800 for lustre-OST0000-osc-ffff8800a9ca3000 00000020:00000080:3.0:1715205900.718170:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1715205900.718174:0:16622:0:(obd_config.c:828:class_detach()) detach on obd lustre-OST0000-osc-ffff8800a9ca3000 (uuid ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:00000080:3.0:1715205900.718177:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9ca2800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:3.0:1715205900.718178:0:16622:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9ca2800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-OST0000-osc-ffff8800a9ca3000 00000020:01000000:3.0:1715205900.718181:0:16622:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-ffff8800a9ca3000 (ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:00000080:3.0:1715205900.718279:0:16622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x68b86d4dd46f4b55 00000020:00000080:3.0:1715205900.718282:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9d1b800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:2.0:1715205900.718316:0:65:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9d1b800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-clilov-ffff8800a9ca3000 00000100:00080000:3.0:1715205900.718406:0:16622:0:(pinger.c:420:ptlrpc_pinger_del_import()) removing pingable import ae639000-c6e7-4dd4-9269-d2ba3337aea4->lustre-MDT0000_UUID 00010000:00010000:3.0:1715205900.718451:0:16622:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932d00/0x68b86d4dd46f4f22 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x1:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4cb6a6a977811491 expref: -99 pid: 14460 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715205900.718465:0:16622:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715205900.718475:0:16622:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932d00/0x68b86d4dd46f4f22 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4cb6a6a977811491 expref: -99 pid: 14460 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715205900.718478:0:16622:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 1/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715205900.718481:0:16622:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 2 locks packed 00000100:00100000:3.0:1715205900.718485:0:16622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfab840 going to sleep for 0 seconds 00000100:00100000:3.0:1715205900.718488:0:16622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513237184:192.168.204.135@tcp:103:umount.0 00010000:00010000:3.0:1715205900.718491:0:16622:0:(ldlm_request.c:1493:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:3.0:1715205900.718493:0:16622:0:(ldlm_request.c:2272:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:3.0:1715205900.718495:0:16622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932d00/0x68b86d4dd46f4f22 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x1:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4cb6a6a977811491 expref: -99 pid: 14460 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715205900.718500:0:16622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa975d40/0x68b86d4dd46f4f0d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0x4cb6a6a97781146e expref: -99 pid: 14455 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1715205900.718552:0:16622:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.718559:0:16622:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205900.718562:0:16622:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1715205900.718564:0:16622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfab840 going to sleep for 0 seconds 00000100:00100000:3.0:1715205900.718566:0:16622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513237248:192.168.204.135@tcp:103:umount.0 00010000:00010000:3.0:1715205900.718572:0:16622:0:(ldlm_request.c:1493:ldlm_cli_cancel_req()) Got rc -108 from cancel RPC: canceling anyway 00010000:00010000:3.0:1715205900.718574:0:16622:0:(ldlm_request.c:2272:ldlm_cli_cancel_list()) ldlm_cli_cancel_list: -108 00010000:00010000:3.0:1715205900.718576:0:16622:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9ca3000 lock: ffff8800aa932ac0/0x68b86d4dd46f4f1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0x4cb6a6a977811483 expref: -99 pid: 14460 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1715205900.719518:0:16622:0:(import.c:86:import_set_state_nolock()) ffff8800a9ca5000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1715205900.719526:0:16622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513237312:192.168.204.135@tcp:39:umount.0 00000100:00100000:3.0:1715205900.719562:0:16622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfab840 going to sleep for 5 seconds 00000100:00100000:3.0:1715205900.720364:0:16622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513237312:192.168.204.135@tcp:39:umount.0 00000100:00080000:3.0:1715205900.720371:0:16622:0:(import.c:86:import_set_state_nolock()) ffff8800a9ca5000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1715205900.720375:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1715205900.720377:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9ca3000: committing for last_committed 4294967319 gen 2 00000100:00100000:3.0:1715205900.720381:0:16622:0:(client.c:2994:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800aa936300 x1798523513236800/t4294967320(4294967320) o4->lustre-MDT0000-mdc-ffff8800a9ca3000@192.168.204.135@tcp:13/10 lens 1488/448 e 0 to 0 dl 1715205916 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 00000100:00100000:3.0:1715205900.720390:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1715205900.721988:0:16622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x68b86d4dd46f4b47 00000020:00000080:3.0:1715205900.721994:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9d55800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:2.0:1715205900.722031:0:65:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9d55800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-MDT0000-mdc-ffff8800a9ca3000 00000100:00080000:3.0:1715205900.722057:0:16622:0:(pinger.c:420:ptlrpc_pinger_del_import()) removing pingable import ae639000-c6e7-4dd4-9269-d2ba3337aea4->lustre-MDT0001_UUID 00000100:00080000:3.0:1715205900.723117:0:16622:0:(import.c:86:import_set_state_nolock()) ffff8800a9ca4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1715205900.723132:0:16622:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513237376:192.168.204.135@tcp:39:umount.0 00000100:00100000:3.0:1715205900.723181:0:16622:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfab840 going to sleep for 5 seconds 00010000:00080000:3.0:1715205900.724176:0:16622:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff88012d7e7480 x1798523513237376/t0(0) o39->lustre-MDT0001-mdc-ffff8800a9ca3000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205910 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 00000100:00100000:3.0:1715205900.724187:0:16622:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7480 pname:cluuid:pid:xid:nid:opc:job umount:ae639000-c6e7-4dd4-9269-d2ba3337aea4:16622:1798523513237376:192.168.204.135@tcp:39:umount.0 00000100:00080000:3.0:1715205900.724206:0:16622:0:(import.c:86:import_set_state_nolock()) ffff8800a9ca4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1715205900.724211:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1715205900.724214:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8800a9ca3000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1715205900.724216:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1715205900.725956:0:16622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x68b86d4dd46f4b4e 00000020:00000080:3.0:1715205900.725962:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9d56800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:3.0:1715205900.725986:0:16622:0:(genops.c:1395:class_disconnect()) disconnect: cookie 0x68b86d4dd46f4b40 00000020:00000080:3.0:1715205900.725989:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9d54000/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:01000000:3.0:1715205900.725996:0:16622:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-clilov-ffff8800a9ca3000 (flags='') 00000020:00000080:3.0:1715205900.726000:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1715205900.726005:0:16622:0:(obd_config.c:900:class_cleanup()) lustre-clilov-ffff8800a9ca3000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1715205900.726009:0:16622:0:(genops.c:1485:class_disconnect_exports()) OBD device 7 (ffff8800a9c88000) has no exports 00000020:00000080:2.0:1715205900.726011:0:65:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9d56800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-MDT0001-mdc-ffff8800a9ca3000 00000020:00000080:2.0:1715205900.726019:0:65:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9d54000/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-clilmv-ffff8800a9ca3000 00000020:00000080:3.0:1715205900.726026:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1715205900.726032:0:16622:0:(obd_config.c:828:class_detach()) detach on obd lustre-clilov-ffff8800a9ca3000 (uuid ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:00000080:3.0:1715205900.726034:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9ca3800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:3.0:1715205900.726036:0:16622:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9ca3800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-clilov-ffff8800a9ca3000 00000020:01000000:3.0:1715205900.726041:0:16622:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-clilov-ffff8800a9ca3000 (ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:01000000:3.0:1715205900.726090:0:16622:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-clilmv-ffff8800a9ca3000 (flags='') 00000020:00000080:3.0:1715205900.726092:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1715205900.726095:0:16622:0:(obd_config.c:900:class_cleanup()) lustre-clilmv-ffff8800a9ca3000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1715205900.726096:0:16622:0:(genops.c:1485:class_disconnect_exports()) OBD device 8 (ffff8800a9c89550) has no exports 00000020:00000080:3.0:1715205900.726109:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1715205900.726111:0:16622:0:(obd_config.c:828:class_detach()) detach on obd lustre-clilmv-ffff8800a9ca3000 (uuid ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:00000080:3.0:1715205900.726113:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9ca4800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:3.0:1715205900.726114:0:16622:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9ca4800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-clilmv-ffff8800a9ca3000 00000020:01000000:3.0:1715205900.726117:0:16622:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-clilmv-ffff8800a9ca3000 (ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:01000000:3.0:1715205900.726174:0:16622:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdc-ffff8800a9ca3000 (flags='') 00000020:00000080:3.0:1715205900.726177:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1715205900.726185:0:16622:0:(obd_config.c:900:class_cleanup()) lustre-MDT0000-mdc-ffff8800a9ca3000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1715205900.726186:0:16622:0:(genops.c:1485:class_disconnect_exports()) OBD device 9 (ffff8800a9c8aaa0) has no exports 00000008:01000000:3.0:1715205900.726218:0:16622:0:(obd_class.h:698:obd_cleanup_client_import()) lustre-MDT0000-mdc-ffff8800a9ca3000: client import never connected 00000100:00080000:3.0:1715205900.726220:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1715205900.726222:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9ca3000: committing for last_committed 4294967319 gen 3 00000100:00100000:3.0:1715205900.726225:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1715205900.728003:0:5:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff8800a9ca5000 for lustre-MDT0000-mdc-ffff8800a9ca3000 00000020:00000080:3.0:1715205900.728065:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1715205900.728071:0:16622:0:(obd_config.c:828:class_detach()) detach on obd lustre-MDT0000-mdc-ffff8800a9ca3000 (uuid ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:00000080:3.0:1715205900.728073:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9ca5800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:3.0:1715205900.728076:0:16622:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9ca5800/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-MDT0000-mdc-ffff8800a9ca3000 00000020:01000000:3.0:1715205900.728079:0:16622:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdc-ffff8800a9ca3000 (ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:01000000:2.0:1715205900.728862:0:16622:0:(obd_config.c:2362:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdc-ffff8800a9ca3000 (flags='') 00000020:00000080:2.0:1715205900.728865:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1715205900.728869:0:16622:0:(obd_config.c:900:class_cleanup()) lustre-MDT0001-mdc-ffff8800a9ca3000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1715205900.728872:0:16622:0:(genops.c:1485:class_disconnect_exports()) OBD device 10 (ffff8800a9c8bff0) has no exports 00000008:01000000:2.0:1715205900.728899:0:16622:0:(obd_class.h:698:obd_cleanup_client_import()) lustre-MDT0001-mdc-ffff8800a9ca3000: client import never connected 00000100:00080000:2.0:1715205900.728901:0:16622:0:(import.c:159:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1715205900.728904:0:16622:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8800a9ca3000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1715205900.728907:0:16622:0:(import.c:337:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1715205900.730578:0:5:0:(genops.c:1112:obd_zombie_import_free()) destroying import ffff8800a9ca4000 for lustre-MDT0001-mdc-ffff8800a9ca3000 00000020:00000080:2.0:1715205900.730650:0:16622:0:(obd_config.c:1409:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1715205900.730657:0:16622:0:(obd_config.c:828:class_detach()) detach on obd lustre-MDT0001-mdc-ffff8800a9ca3000 (uuid ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000020:00000080:2.0:1715205900.730660:0:16622:0:(genops.c:924:class_export_put()) final put ffff8800a9ca1000/ae639000-c6e7-4dd4-9269-d2ba3337aea4 00000020:00000080:2.0:1715205900.730662:0:16622:0:(genops.c:882:class_export_destroy()) destroying export ffff8800a9ca1000/ae639000-c6e7-4dd4-9269-d2ba3337aea4 for lustre-MDT0001-mdc-ffff8800a9ca3000 00000020:01000000:2.0:1715205900.730671:0:16622:0:(genops.c:467:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdc-ffff8800a9ca3000 (ae639000-c6e7-4dd4-9269-d2ba3337aea4) 00000080:02000400:0.0:1715205900.731861:0:16622:0:(llite_lib.c:1596:ll_put_super()) Unmounted lustre-client 00000020:01000000:0.0:1715205900.732947:0:16622:0:(obd_config.c:1142:class_del_profile()) Del profile lustre-client 00000020:01000004:0.0:1715205900.733126:0:16622:0:(obd_mount.c:976:lustre_common_put_super()) dropping sb ffff8800a9ca3000 00000020:01000004:0.0:1715205900.733129:0:16622:0:(obd_mount.c:548:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000004:0.0:1715205900.733135:0:16622:0:(obd_mount.c:989:lustre_common_put_super()) MGC still in use 00000020:01000004:0.0:1715205900.733136:0:16622:0:(obd_mount.c:704:lustre_put_lsi()) put ffff8800a9ca3000 1 00000020:01000004:0.0:1715205900.733140:0:16622:0:(obd_mount.c:629:lustre_free_lsi()) Freeing lsi ffff8800a9ca1800 00010000:00010000:1.0:1715205900.779909:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1715205901.151885:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715205901.151889:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715205901.151914:0:2006:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2006:1798523513237504:192.168.204.135@tcp:400:kworker.0 00000100:00100000:3.0:1715205901.151924:0:2007:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2007:1798523513237440:192.168.204.135@tcp:400:kworker.0 00000100:00100000:2.0:1715205901.152749:0:2007:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2007:1798523513237440:192.168.204.135@tcp:400:kworker.0 00010000:00080000:3.0:1715205901.152760:0:2006:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa935180 x1798523513237504/t0(0) o400->lustre-MDT0001-mdc-ffff8800b3e33000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:3.0:1715205901.152771:0:2006:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2006:1798523513237504:192.168.204.135@tcp:400:kworker.0 00000001:02000400:3.0:1715205901.217346:0:16833:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1715205901.782016:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205902.783920:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205903.785987:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205904.787933:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205905.538347:0:17495:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1715205905.789944:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1715205906.159884:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715205906.159889:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715205906.159917:0:2006:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2006:1798523513237632:192.168.204.135@tcp:400:kworker.0 00000100:00100000:3.0:1715205906.159920:0:2007:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2007:1798523513237568:192.168.204.135@tcp:400:kworker.0 00000100:00100000:2.0:1715205906.160770:0:2007:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2007:1798523513237568:192.168.204.135@tcp:400:kworker.0 00010000:00080000:3.0:1715205906.160775:0:2006:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa937b80 x1798523513237632/t0(0) o400->lustre-MDT0001-mdc-ffff8800b3e33000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:3.0:1715205906.160785:0:2006:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2006:1798523513237632:192.168.204.135@tcp:400:kworker.0 00000100:00100000:2.0:1715205906.312590:0:1998:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.135@tcp (source: 12345-192.168.204.135@tcp) 00000100:00100000:3.0:1715205906.312651:0:5356:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523518515136 00000100:00100000:3.0:1715205906.312659:0:5356:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523518515136 00000100:00100000:3.0:1715205906.312695:0:5356:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.135@tcp, seq: 9 00000100:00100000:3.0:1715205906.312700:0:5356:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aa934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8+3:23461:x1798523518515136:12345-192.168.204.135@tcp:104: 00010000:00010000:3.0:1715205906.312720:0:5356:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205906.312778:0:5356:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1715205906.312784:0:5356:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aa934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8+3:23461:x1798523518515136:12345-192.168.204.135@tcp:104: Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205906.312790:0:5356:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.135@tcp, seq: 9 00010000:00010000:1.0:1715205906.312819:0:5365:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205906.312826:0:5365:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.312832:0:5365:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa974fc0 already unused, calling callback (ffffffffa04cea40) 10000000:00010000:1.0:1715205906.312835:0:5365:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.312841:0:5365:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205906.312847:0:5365:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205906.312850:0:5365:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1715205906.312878:0:5365:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.312882:0:5365:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205906.312903:0:5365:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.312909:0:5365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff8800aa974fc0/0x68b86d4dd46f4bc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a97781138e expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205906.312922:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205906.312923:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205906.312924:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205906.312935:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513237696:192.168.204.135@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1715205906.313975:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513237696:192.168.204.135@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715205906.791954:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1715205907.209113:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:0.0:1715205907.209134:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205907.209177:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209184:0:15978:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209192:0:15978:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00000100:00100000:0.0:1715205907.209205:0:15978:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3f00 going to sleep for 0 seconds 00000100:00100000:0.0:1715205907.209214:0:15978:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:15978:1798523513237760:192.168.204.135@tcp:101:bash.0 00010000:00010000:0.0:1715205907.209221:0:15978:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209225:0:15978:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209229:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209234:0:15978:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209246:0:15978:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209251:0:15978:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa974900 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:0.0:1715205907.209254:0:15978:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209258:0:15978:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209262:0:15978:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209266:0:15978:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205907.209270:0:15978:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209274:0:15978:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa974900/0x68b86d4dd46f4f61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00000080:00020000:0.0:1715205907.209289:0:15978:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205907.209332:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:0.0:1715205907.209338:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205907.209351:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209356:0:15978:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209360:0:15978:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00000100:00100000:0.0:1715205907.209366:0:15978:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3f00 going to sleep for 0 seconds 00000100:00100000:0.0:1715205907.209373:0:15978:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:15978:1798523513237824:192.168.204.135@tcp:101:bash.0 00010000:00010000:0.0:1715205907.209379:0:15978:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209382:0:15978:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209385:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209387:0:15978:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209390:0:15978:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209392:0:15978:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa975d40 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:0.0:1715205907.209394:0:15978:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209396:0:15978:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209398:0:15978:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209401:0:15978:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205907.209402:0:15978:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209404:0:15978:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975d40/0x68b86d4dd46f4f68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00000080:00020000:0.0:1715205907.209414:0:15978:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205907.209460:0:15978:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:0.0:1715205907.209481:0:15978:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205907.209493:0:15978:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209498:0:15978:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209503:0:15978:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00000100:00100000:0.0:1715205907.209509:0:15978:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3f00 going to sleep for 0 seconds 00000100:00100000:0.0:1715205907.209512:0:15978:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:15978:1798523513237888:192.168.204.135@tcp:101:bash.0 00010000:00010000:0.0:1715205907.209517:0:15978:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209521:0:15978:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209524:0:15978:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209528:0:15978:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209531:0:15978:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209535:0:15978:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa975f80 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:0.0:1715205907.209536:0:15978:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209540:0:15978:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209547:0:15978:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209551:0:15978:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205907.209553:0:15978:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00010000:00010000:0.0:1715205907.209556:0:15978:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa975f80/0x68b86d4dd46f4f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 15978 initiator: MDT0 00000080:00020000:0.0:1715205907.209566:0:15978:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205907.211523:0:17924:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205907.211533:0:17924:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205907.211552:0:17924:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211557:0:17924:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211561:0:17924:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17924 initiator: MDT0 00000100:00100000:1.0:1715205907.211568:0:17924:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f540 going to sleep for 0 seconds 00000100:00100000:1.0:1715205907.211572:0:17924:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:17924:1798523513237952:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205907.211576:0:17924:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211579:0:17924:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211582:0:17924:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211584:0:17924:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211587:0:17924:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211590:0:17924:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa933a80 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205907.211591:0:17924:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211594:0:17924:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211600:0:17924:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211602:0:17924:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205907.211604:0:17924:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211607:0:17924:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933a80/0x68b86d4dd46f4f76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17924 initiator: MDT0 00000080:00020000:1.0:1715205907.211615:0:17924:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205907.211636:0:17924:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205907.211640:0:17924:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205907.211648:0:17924:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211651:0:17924:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211654:0:17924:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17924 initiator: MDT0 00000100:00100000:1.0:1715205907.211657:0:17924:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f540 going to sleep for 0 seconds 00000100:00100000:1.0:1715205907.211660:0:17924:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:17924:1798523513238016:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205907.211663:0:17924:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211666:0:17924:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211668:0:17924:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211674:0:17924:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211678:0:17924:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211681:0:17924:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa930fc0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205907.211683:0:17924:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211688:0:17924:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211692:0:17924:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211696:0:17924:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205907.211698:0:17924:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17924 initiator: MDT0 00010000:00010000:1.0:1715205907.211702:0:17924:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930fc0/0x68b86d4dd46f4f7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17924 initiator: MDT0 00000080:00020000:1.0:1715205907.211713:0:17924:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:1.0:1715205907.793878:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1715205907.844840:0:5367:0:(mgc_request.c:626:do_requeue()) updating log params 10000000:01000000:0.0:1715205907.844843:0:5367:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff8800b3e33000 from 7 10000000:01000000:0.0:1715205907.844846:0:5367:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1715205907.844874:0:5367:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205907.844880:0:5367:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205907.844887:0:5367:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205907.844904:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513238080:192.168.204.135@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1715205907.844955:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205907.845928:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513238080:192.168.204.135@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1715205907.845940:0:5367:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205907.845945:0:5367:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205907.845979:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513238144:192.168.204.135@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1715205907.846003:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205907.846670:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513238144:192.168.204.135@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1715205907.846691:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513238208:192.168.204.135@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1715205907.846720:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3480 going to sleep for 11 seconds 00000100:00100000:0.0:1715205907.847336:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513238208:192.168.204.135@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1715205907.847469:0:18244:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:18244:1798523513238272:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205907.847509:0:18244:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715205907.848122:0:18244:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:18244:1798523513238272:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205907.848142:0:18244:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205907.848150:0:18244:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205907.848154:0:18244:0:(obd_config.c:1497:class_process_config()) marker 4 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1715205907.848159:0:18244:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff8800b3e33000 00000020:00000080:1.0:1715205907.848161:0:18244:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1715205907.848213:0:18244:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:18244:1798523513238336:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205907.848239:0:18244:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715205907.848978:0:18244:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:18244:1798523513238336:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205907.848995:0:18244:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205907.848997:0:18244:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205907.848999:0:18244:0:(obd_config.c:1497:class_process_config()) marker 4 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1715205907.849001:0:18244:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1715205907.849331:0:5367:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1715205907.849344:0:5367:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1715205907.849350:0:5367:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205907.849358:0:5367:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205908.795905:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205909.797887:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205909.889629:0:18646:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test sanityn: Run sanityn with Data-on-MDT files ========================================================== 18:05:09 (1715205909) 00010000:00010000:1.0:1715205910.799866:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1715205911.167971:0:297:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715205911.167976:0:297:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715205911.168010:0:2006:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2006:1798523513238464:192.168.204.135@tcp:400:kworker.0 00000100:00100000:3.0:1715205911.168011:0:2007:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2007:1798523513238400:192.168.204.135@tcp:400:kworker.0 00000100:00100000:2.0:1715205911.169012:0:2007:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2007:1798523513238400:192.168.204.135@tcp:400:kworker.0 00010000:00080000:3.0:1715205911.169014:0:2006:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa935f80 x1798523513238464/t0(0) o400->lustre-MDT0001-mdc-ffff8800b3e33000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:3.0:1715205911.169023:0:2006:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2006:1798523513238464:192.168.204.135@tcp:400:kworker.0 00010000:00010000:1.0:1715205911.801953:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205912.803930:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715205913.109003:0:19085:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 28 00000001:02000400:1.0:1715205913.440388:0:19239:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: skipping tests SLOW=no: 33a 00000080:00200008:0.0:1715205913.470674:0:18662:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205913.470681:0:18662:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:0.0:1715205913.470700:0:18662:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205913.470740:0:18662:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470747:0:18662:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470754:0:18662:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00000100:00100000:0.0:1715205913.470772:0:18662:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3a80 going to sleep for 0 seconds 00000100:00100000:0.0:1715205913.470780:0:18662:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:18662:1798523513238528:192.168.204.135@tcp:101:bash.0 00010000:00010000:0.0:1715205913.470787:0:18662:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470791:0:18662:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470795:0:18662:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470815:0:18662:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470819:0:18662:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470822:0:18662:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa976400 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:0.0:1715205913.470825:0:18662:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470829:0:18662:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470834:0:18662:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470837:0:18662:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205913.470840:0:18662:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470843:0:18662:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976400/0x68b86d4dd46f4f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00000080:00020000:0.0:1715205913.470862:0:18662:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715205913.470906:0:18662:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715205913.470910:0:18662:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:0.0:1715205913.470916:0:18662:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205913.470932:0:18662:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470938:0:18662:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470944:0:18662:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00000100:00100000:0.0:1715205913.470952:0:18662:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3a80 going to sleep for 0 seconds 00000100:00100000:0.0:1715205913.470957:0:18662:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:18662:1798523513238592:192.168.204.135@tcp:101:bash.0 00010000:00010000:0.0:1715205913.470962:0:18662:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470967:0:18662:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470971:0:18662:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470975:0:18662:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470979:0:18662:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470983:0:18662:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa976640 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:0.0:1715205913.470989:0:18662:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470994:0:18662:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.470998:0:18662:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.471002:0:18662:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205913.471005:0:18662:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205913.471009:0:18662:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976640/0x68b86d4dd46f4f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00000080:00020000:0.0:1715205913.471021:0:18662:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715205913.476125:0:18662:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205913.476132:0:18662:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:2.0:1715205913.476150:0:18662:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205913.476189:0:18662:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476197:0:18662:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476210:0:18662:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00000100:00100000:2.0:1715205913.476222:0:18662:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e15b300 going to sleep for 0 seconds 00000100:00100000:2.0:1715205913.476231:0:18662:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:18662:1798523513238656:192.168.204.135@tcp:101:bash.0 00010000:00010000:2.0:1715205913.476239:0:18662:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476244:0:18662:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476249:0:18662:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476253:0:18662:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476258:0:18662:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476263:0:18662:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa964900 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:2.0:1715205913.476266:0:18662:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476271:0:18662:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476275:0:18662:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476280:0:18662:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715205913.476283:0:18662:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476292:0:18662:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964900/0x68b86d4dd46f4f99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00000080:00020000:2.0:1715205913.476308:0:18662:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715205913.476384:0:18662:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b0a680c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715205913.476388:0:18662:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:2.0:1715205913.476395:0:18662:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715205913.476407:0:18662:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476411:0:18662:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476415:0:18662:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00000100:00100000:2.0:1715205913.476420:0:18662:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e15b300 going to sleep for 0 seconds 00000100:00100000:2.0:1715205913.476423:0:18662:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:18662:1798523513238720:192.168.204.135@tcp:101:bash.0 00010000:00010000:2.0:1715205913.476427:0:18662:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476430:0:18662:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476433:0:18662:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476436:0:18662:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476439:0:18662:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476445:0:18662:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa964fc0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:2.0:1715205913.476446:0:18662:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476449:0:18662:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476452:0:18662:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476455:0:18662:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715205913.476457:0:18662:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00010000:00010000:2.0:1715205913.476459:0:18662:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa964fc0/0x68b86d4dd46f4fa0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00000080:00020000:2.0:1715205913.476467:0:18662:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:01200004:0.0:1715205913.534102:0:19295:0:(super25.c:129:lustre_fill_super()) VFS Op: sb ffff8800a9d1f000 00000020:01000004:0.0:1715205913.534118:0:19295:0:(obd_mount.c:1002:lmd_print()) mount data: 00000020:01000004:0.0:1715205913.534119:0:19295:0:(obd_mount.c:1004:lmd_print()) profile: lustre-client 00000020:01000004:0.0:1715205913.534120:0:19295:0:(obd_mount.c:1005:lmd_print()) device: 192.168.204.135@tcp:/lustre 00000020:01000004:0.0:1715205913.534121:0:19295:0:(obd_mount.c:1008:lmd_print()) options: user_xattr,flock 00000080:01000004:0.0:1715205913.534122:0:19295:0:(super25.c:172:lustre_fill_super()) Mounting client lustre-client 00000020:01000004:0.0:1715205913.534136:0:19295:0:(obd_mount.c:352:lustre_start_mgc()) MGC192.168.204.135@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1715205913.534139:0:19295:0:(mgc_request.c:1063:mgc_set_info_async()) InitRecov MGC192.168.204.135@tcp 1/d0:i0:r0:or0:FULL 00000080:00200000:0.0:1715205913.534142:0:19295:0:(llite_lib.c:1367:ll_fill_super()) VFS Op: cfg_instance lustre-client-ffff8800a9d1f000 (sb ffff8800a9d1f000) 00000080:01000000:0.0:1715205913.534189:0:19295:0:(llite_lib.c:1088:ll_options()) Parsing opts user_xattr,flock 00000080:00000004:0.0:1715205913.534190:0:19295:0:(llite_lib.c:1098:ll_options()) next opt=user_xattr 00000080:00000004:0.0:1715205913.534191:0:19295:0:(llite_lib.c:1098:ll_options()) next opt=flock 00000080:01000000:0.0:1715205913.534196:0:19295:0:(llite_lib.c:1401:ll_fill_super()) llite sb uuid: 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7 10000000:01000000:0.0:1715205913.534398:0:19295:0:(mgc_request.c:1899:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1715205913.534400:0:19295:0:(mgc_request.c:342:config_log_add()) add config log lustre-client-ffff8800a9d1f000 10000000:01000000:0.0:1715205913.534404:0:19295:0:(mgc_request.c:214:do_config_log_add()) do adding config log params-ffff8800a9d1f000 10000000:01000000:0.0:1715205913.534406:0:19295:0:(mgc_request.c:88:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1715205913.534408:0:19295:0:(mgc_request.c:214:do_config_log_add()) do adding config log lustre-client-ffff8800a9d1f000 10000000:01000000:0.0:1715205913.534412:0:19295:0:(mgc_request.c:88:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1715205913.534414:0:19295:0:(mgc_request.c:214:do_config_log_add()) do adding config log lustre-cliir-ffff8800a9d1f000 10000000:01000000:0.0:1715205913.534416:0:19295:0:(mgc_request.c:88:mgc_name2resid()) log lustre-cliir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1715205913.534418:0:19295:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800a9d1f000 from 1 10000000:01000000:0.0:1715205913.534420:0:19295:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1715205913.534447:0:19295:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa976640/0x68b86d4dd46f4fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205913.534453:0:19295:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff8800aa976640/0x68b86d4dd46f4fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205913.534460:0:19295:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff8800aa976640/0x68b86d4dd46f4fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205913.534475:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513238784:192.168.204.135@tcp:101:mount.lustre.0 00000100:00100000:0.0:1715205913.534533:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3900 going to sleep for 11 seconds 00000100:00100000:1.0:1715205913.535826:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513238784:192.168.204.135@tcp:101:mount.lustre.0 00010000:00010000:1.0:1715205913.535840:0:19295:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff8800aa976640/0x68b86d4dd46f4fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114e5 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205913.535848:0:19295:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff8800aa976640/0x68b86d4dd46f4fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a9778114e5 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205913.535883:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513238848:192.168.204.135@tcp:501:mount.lustre.0 00000100:00100000:1.0:1715205913.535908:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715205913.536607:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513238848:192.168.204.135@tcp:501:mount.lustre.0 00000100:00100000:1.0:1715205913.536636:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513238912:192.168.204.135@tcp:503:mount.lustre.0 00000100:00100000:1.0:1715205913.536669:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715205913.537606:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513238912:192.168.204.135@tcp:503:mount.lustre.0 00000100:00100000:1.0:1715205913.537814:0:19298:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19298:1798523513238976:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205913.537844:0:19298:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b3c5f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715205913.538551:0:19298:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa029880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19298:1798523513238976:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205913.538568:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205913.538575:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.538576:0:19298:0:(obd_config.c:1497:class_process_config()) marker 4 (0x1) lustre-clilov lov setup 00000020:01000000:1.0:1715205913.538580:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-clilov-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.538581:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1715205913.538590:0:19298:0:(genops.c:436:class_newdev()) Allocate new device lustre-clilov-ffff8800a9d1f000 (ffff8800a9c8bff0) 00000020:00000080:1.0:1715205913.538601:0:19298:0:(obd_config.c:671:class_attach()) OBD: dev 7 attached type lov with refcount 2 00000020:01000000:1.0:1715205913.538604:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-clilov-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.538605:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00000020:00000080:1.0:1715205913.538740:0:19298:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-clilov-ffff8800a9d1f000 (uuid 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) 00000020:01000000:1.0:1715205913.538744:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.538746:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.538746:0:19298:0:(obd_config.c:1497:class_process_config()) marker 4 (0x2) lustre-clilov lov setup 00000020:01000000:1.0:1715205913.538748:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205913.538749:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.538750:0:19298:0:(obd_config.c:1497:class_process_config()) marker 5 (0x1) lustre-clilmv lmv setup 00000020:01000000:1.0:1715205913.538752:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-clilmv-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.538753:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1715205913.538758:0:19298:0:(genops.c:436:class_newdev()) Allocate new device lustre-clilmv-ffff8800a9d1f000 (ffff8800a9c8aaa0) 00000020:00000080:1.0:1715205913.538763:0:19298:0:(obd_config.c:671:class_attach()) OBD: dev 8 attached type lmv with refcount 2 00000020:01000000:1.0:1715205913.538765:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-clilmv-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.538769:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00000020:00000080:1.0:1715205913.538860:0:19298:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-clilmv-ffff8800a9d1f000 (uuid 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) 00000020:01000000:1.0:1715205913.538863:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.538864:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.538865:0:19298:0:(obd_config.c:1497:class_process_config()) marker 5 (0x2) lustre-clilmv lmv setup 00000020:01000000:1.0:1715205913.538867:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205913.538868:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.538869:0:19298:0:(obd_config.c:1497:class_process_config()) marker 6 (0x1) lustre-client mount opts 00000020:00000080:1.0:1715205913.538870:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1715205913.538871:0:19298:0:(obd_config.c:1450:class_process_config()) mountopt: profile lustre-client osc lustre-clilov mdc lustre-clilmv 00000020:01000000:1.0:1715205913.538873:0:19298:0:(obd_config.c:1090:class_add_profile()) Add profile lustre-client 00000020:01000000:1.0:1715205913.538875:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.538876:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.538877:0:19298:0:(obd_config.c:1497:class_process_config()) marker 6 (0x2) lustre-client mount opts 00000020:01000000:1.0:1715205913.538878:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205913.538880:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.538880:0:19298:0:(obd_config.c:1497:class_process_config()) marker 7 (0x1) lustre-MDT0000 add mdc 00000020:00000080:1.0:1715205913.538882:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1715205913.538884:0:19298:0:(obd_config.c:1421:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1715205913.538893:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-MDT0000-mdc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.538894:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1715205913.538899:0:19298:0:(genops.c:436:class_newdev()) Allocate new device lustre-MDT0000-mdc-ffff8800a9d1f000 (ffff8800a9c89550) 00000020:00000080:1.0:1715205913.538905:0:19298:0:(obd_config.c:671:class_attach()) OBD: dev 9 attached type mdc with refcount 2 00000020:01000000:1.0:1715205913.538907:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-MDT0000-mdc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.538908:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00010000:00080000:1.0:1715205913.538941:0:19298:0:(ldlm_lib.c:119:import_set_conn()) imp ffff8800a94e9800@lustre-MDT0000-mdc-ffff8800a9d1f000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1715205913.540245:0:19298:0:(ldlm_pool.c:943:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-mdc-ffff8800a9d1f000-5 is initialized 00000040:01000000:1.0:1715205913.540341:0:19298:0:(llog_obd.c:212:llog_setup()) obd lustre-MDT0000-mdc-ffff8800a9d1f000 ctxt 13 is initialized 00000020:00000080:1.0:1715205913.540368:0:19298:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-MDT0000-mdc-ffff8800a9d1f000 (uuid 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) 00000020:01000000:1.0:1715205913.540373:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf014, instance name: lustre-clilmv-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.540375:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf014 00800000:01000000:1.0:1715205913.540383:0:19298:0:(lmv_obd.c:432:lmv_add_target()) Target uuid: lustre-MDT0000_UUID. index 0 00000020:01000000:1.0:1715205913.540402:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.540404:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.540405:0:19298:0:(obd_config.c:1497:class_process_config()) marker 7 (0x2) lustre-MDT0000 add mdc 00000020:01000000:1.0:1715205913.540406:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1715205913.540408:0:19298:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1715205913.540409:0:19298:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205913.540409:0:19298:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205913.540410:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1715205913.540411:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.540412:0:19298:0:(obd_config.c:1497:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1715205913.540413:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205913.540414:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.540415:0:19298:0:(obd_config.c:1497:class_process_config()) marker 16 (0x1) lustre-MDT0001 add mdc 00000020:00000080:1.0:1715205913.540416:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1715205913.540418:0:19298:0:(obd_config.c:1421:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1715205913.540424:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-MDT0001-mdc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.540425:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1715205913.540429:0:19298:0:(genops.c:436:class_newdev()) Allocate new device lustre-MDT0001-mdc-ffff8800a9d1f000 (ffff8800a9c88000) 00000020:00000080:1.0:1715205913.540435:0:19298:0:(obd_config.c:671:class_attach()) OBD: dev 10 attached type mdc with refcount 2 00000020:01000000:1.0:1715205913.540437:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-MDT0001-mdc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.540438:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00010000:00080000:1.0:1715205913.540464:0:19298:0:(ldlm_lib.c:119:import_set_conn()) imp ffff8800a94ee800@lustre-MDT0001-mdc-ffff8800a9d1f000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1715205913.541576:0:19298:0:(ldlm_pool.c:943:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-mdc-ffff8800a9d1f000-6 is initialized 00000040:01000000:1.0:1715205913.541658:0:19298:0:(llog_obd.c:212:llog_setup()) obd lustre-MDT0001-mdc-ffff8800a9d1f000 ctxt 13 is initialized 00000020:00000080:1.0:1715205913.541671:0:19298:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-MDT0001-mdc-ffff8800a9d1f000 (uuid 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) 00000020:01000000:1.0:1715205913.541674:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf014, instance name: lustre-clilmv-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.541676:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf014 00800000:01000000:1.0:1715205913.541679:0:19298:0:(lmv_obd.c:432:lmv_add_target()) Target uuid: lustre-MDT0001_UUID. index 1 00000020:01000000:1.0:1715205913.541691:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.541693:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.541694:0:19298:0:(obd_config.c:1497:class_process_config()) marker 16 (0x2) lustre-MDT0001 add mdc 00000020:01000000:1.0:1715205913.541698:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1715205913.541699:0:19298:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1715205913.541700:0:19298:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205913.541701:0:19298:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205913.541702:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1715205913.541703:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.541704:0:19298:0:(obd_config.c:1497:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1715205913.541705:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1715205913.541707:0:19298:0:(obd_mount.c:1040:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of 192.168.204.135@tcp:/lustre 00000020:00000080:1.0:1715205913.541708:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.541709:0:19298:0:(obd_config.c:1497:class_process_config()) marker 25 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1715205913.541710:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1715205913.541712:0:19298:0:(obd_config.c:1421:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1715205913.541718:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-OST0000-osc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.541719:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1715205913.541725:0:19298:0:(genops.c:436:class_newdev()) Allocate new device lustre-OST0000-osc-ffff8800a9d1f000 (ffff8800a9c8d540) 00000020:00000080:1.0:1715205913.541733:0:19298:0:(obd_config.c:671:class_attach()) OBD: dev 11 attached type osc with refcount 2 00000020:01000000:1.0:1715205913.541736:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-OST0000-osc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.541738:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00010000:00080000:1.0:1715205913.541774:0:19298:0:(ldlm_lib.c:119:import_set_conn()) imp ffff8800a94ef000@lustre-OST0000-osc-ffff8800a9d1f000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1715205913.541969:0:19298:0:(ldlm_pool.c:943:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-ffff8800a9d1f000-7 is initialized 00000020:00000080:1.0:1715205913.542111:0:19298:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-OST0000-osc-ffff8800a9d1f000 (uuid 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) 00000020:01000000:1.0:1715205913.542115:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf00d, instance name: lustre-clilov-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.542116:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00d 00020000:01000000:1.0:1715205913.542123:0:19298:0:(lov_obd.c:489:lov_add_target()) uuid:lustre-OST0000_UUID idx:0 gen:1 active:1 00020000:01000000:1.0:1715205913.542127:0:19298:0:(lov_obd.c:540:lov_add_target()) tgts: ffff8800b5ec1840 size: 2 00020000:01000000:1.0:1715205913.542129:0:19298:0:(lov_obd.c:569:lov_add_target()) idx=0 ltd_gen=1 ld_tgt_count=1 00000020:01000000:1.0:1715205913.542135:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.542138:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.542139:0:19298:0:(obd_config.c:1497:class_process_config()) marker 25 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1715205913.542141:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1715205913.542142:0:19298:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1715205913.542148:0:19298:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205913.542149:0:19298:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1715205913.542150:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1715205913.542152:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.542153:0:19298:0:(obd_config.c:1497:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1715205913.542155:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1715205913.542157:0:19298:0:(obd_mount.c:1040:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of 192.168.204.135@tcp:/lustre 00000020:00000080:1.0:1715205913.542160:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.542161:0:19298:0:(obd_config.c:1497:class_process_config()) marker 33 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1715205913.542162:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1715205913.542165:0:19298:0:(obd_config.c:1421:class_process_config()) adding mapping from uuid 192.168.204.135@tcp to nid 0x20000c0a8cc87 (192.168.204.135@tcp) 00000020:01000000:1.0:1715205913.542173:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf001, instance name: lustre-OST0001-osc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.542175:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1715205913.542180:0:19298:0:(genops.c:436:class_newdev()) Allocate new device lustre-OST0001-osc-ffff8800a9d1f000 (ffff8800a9c8ea90) 00000020:00000080:1.0:1715205913.542188:0:19298:0:(obd_config.c:671:class_attach()) OBD: dev 12 attached type osc with refcount 2 00000020:01000000:1.0:1715205913.542192:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf003, instance name: lustre-OST0001-osc-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.542194:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf003 00010000:00080000:1.0:1715205913.542228:0:19298:0:(ldlm_lib.c:119:import_set_conn()) imp ffff8800a94ea800@lustre-OST0001-osc-ffff8800a9d1f000: add connection 192.168.204.135@tcp at head 00010000:00010000:1.0:1715205913.542395:0:19298:0:(ldlm_pool.c:943:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-ffff8800a9d1f000-8 is initialized 00000020:00000080:1.0:1715205913.542508:0:19298:0:(obd_config.c:775:class_setup()) finished setup of obd lustre-OST0001-osc-ffff8800a9d1f000 (uuid 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) 00000020:01000000:1.0:1715205913.542512:0:19298:0:(obd_config.c:1941:class_config_llog_handler()) cmd cf00d, instance name: lustre-clilov-ffff8800a9d1f000 00000020:00000080:1.0:1715205913.542513:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00d 00020000:01000000:1.0:1715205913.542519:0:19298:0:(lov_obd.c:489:lov_add_target()) uuid:lustre-OST0001_UUID idx:1 gen:1 active:1 00020000:01000000:1.0:1715205913.542522:0:19298:0:(lov_obd.c:569:lov_add_target()) idx=1 ltd_gen=1 ld_tgt_count=2 00000020:01000000:1.0:1715205913.542527:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.542528:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.542529:0:19298:0:(obd_config.c:1497:class_process_config()) marker 33 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1715205913.542531:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205913.542532:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.542533:0:19298:0:(obd_config.c:1497:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1715205913.542534:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1715205913.542535:0:19298:0:(obd_config.c:1471:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1715205913.542539:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.542540:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.542541:0:19298:0:(obd_config.c:1497:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000100:00100000:1.0:1715205913.542562:0:19298:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19298:1798523513239040:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205913.542609:0:19298:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24780 going to sleep for 11 seconds 00000100:00100000:1.0:1715205913.543502:0:19298:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19298:1798523513239040:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205913.543525:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205913.543530:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.543531:0:19298:0:(obd_config.c:1497:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1715205913.543535:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1715205913.543552:0:19298:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19298:1798523513239104:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205913.543594:0:19298:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24780 going to sleep for 11 seconds 00000100:00100000:1.0:1715205913.544224:0:19298:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19298:1798523513239104:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205913.544241:0:19298:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205913.544245:0:19298:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205913.544246:0:19298:0:(obd_config.c:1497:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1715205913.544248:0:19298:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1715205913.544299:0:19295:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1715205913.544318:0:19295:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715205913.544336:0:19295:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa976640/0x68b86d4dd46f4fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114e5 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205913.544357:0:19295:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff8800aa976640/0x68b86d4dd46f4fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114e5 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715205913.544364:0:19295:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-cliir-ffff8800a9d1f000 from 1 10000000:01000000:2.0:1715205913.544367:0:19295:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-cliir (res 0x65727473756c) 00010000:00010000:2.0:1715205913.544387:0:19295:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964fc0/0x68b86d4dd46f4fd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205913.544394:0:19295:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff8800aa964fc0/0x68b86d4dd46f4fd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205913.544408:0:19295:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff8800aa964fc0/0x68b86d4dd46f4fd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205913.544420:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239168:192.168.204.135@tcp:101:mount.lustre.0 00000100:00100000:2.0:1715205913.544454:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e15b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1715205913.545153:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239168:192.168.204.135@tcp:101:mount.lustre.0 00010000:00010000:0.0:1715205913.545165:0:19295:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff8800aa964fc0/0x68b86d4dd46f4fd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114ec expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205913.545172:0:19295:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff8800aa964fc0/0x68b86d4dd46f4fd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a9778114ec expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205913.545539:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa972680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239232:192.168.204.135@tcp:256:mount.lustre.0 00000100:00100000:0.0:1715205913.545571:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3900 going to sleep for 11 seconds 00000100:00100000:0.0:1715205913.546789:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239232:192.168.204.135@tcp:256:mount.lustre.0 00000020:00000080:0.0:1715205913.546843:0:19295:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1715205913.546906:0:19295:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1715205913.546931:0:19295:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 00000020:00000080:0.0:1715205913.546964:0:19295:0:(obd_config.c:1409:class_process_config()) processing cmd: cf00f 10000000:01000000:0.0:1715205913.547323:0:19295:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'lustre-cliir' succeeded (0). 00010000:00010000:0.0:1715205913.547330:0:19295:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa964fc0/0x68b86d4dd46f4fd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114ec expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205913.547335:0:19295:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff8800aa964fc0/0x68b86d4dd46f4fd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114ec expref: -99 pid: 19295 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715205913.547343:0:19295:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff8800a9d1f000 from 1 10000000:01000000:0.0:1715205913.547358:0:19295:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1715205913.547370:0:19295:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205913.547374:0:19295:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205913.547378:0:19295:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205913.547386:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa972680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239296:192.168.204.135@tcp:101:mount.lustre.0 00000100:00100000:0.0:1715205913.547410:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3900 going to sleep for 11 seconds 00000100:00100000:2.0:1715205913.548060:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa972680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239296:192.168.204.135@tcp:101:mount.lustre.0 00010000:00010000:2.0:1715205913.548071:0:19295:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205913.548079:0:19295:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205913.548111:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa935500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239360:192.168.204.135@tcp:501:mount.lustre.0 00000100:00100000:2.0:1715205913.548143:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e15be40 going to sleep for 11 seconds 00000100:00100000:2.0:1715205913.548762:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa935500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239360:192.168.204.135@tcp:501:mount.lustre.0 00000100:00100000:2.0:1715205913.548785:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa935500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239424:192.168.204.135@tcp:503:mount.lustre.0 00000100:00100000:2.0:1715205913.548844:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e15be40 going to sleep for 11 seconds 00000100:00100000:2.0:1715205913.549469:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa935500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19295:1798523513239424:192.168.204.135@tcp:503:mount.lustre.0 00000100:00100000:0.0:1715205913.551095:0:19305:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19305:1798523513239488:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:0.0:1715205913.551130:0:19305:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3240 going to sleep for 11 seconds 00000100:00100000:0.0:1715205913.551775:0:19305:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19305:1798523513239488:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:0.0:1715205913.551793:0:19305:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1715205913.551796:0:19305:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #2 00000020:01000000:0.0:1715205913.551797:0:19305:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1715205913.551798:0:19305:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1715205913.551818:0:19305:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1715205913.551826:0:19305:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205913.551832:0:19305:0:(obd_config.c:1497:class_process_config()) marker 2 (0x6) general lod.*.mdt_hash 00000020:01000000:0.0:1715205913.551835:0:19305:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1715205913.551836:0:19305:0:(obd_config.c:1835:class_config_llog_handler()) SKIP #3 00000020:01000000:0.0:1715205913.551837:0:19305:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1715205913.551838:0:19305:0:(obd_config.c:1861:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1715205913.551839:0:19305:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1715205913.551841:0:19305:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205913.551842:0:19305:0:(obd_config.c:1497:class_process_config()) marker 3 (0x6) general lod.*.mdt_hash 00000020:01000000:0.0:1715205913.551844:0:19305:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1715205913.551845:0:19305:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205913.551846:0:19305:0:(obd_config.c:1497:class_process_config()) marker 4 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1715205913.551849:0:19305:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff8800a9d1f000 00000020:00000080:0.0:1715205913.551851:0:19305:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1715205913.551901:0:19305:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19305:1798523513239552:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:0.0:1715205913.551937:0:19305:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3240 going to sleep for 11 seconds 00000100:00100000:0.0:1715205913.552519:0:19305:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa971f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:19305:1798523513239552:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:0.0:1715205913.552532:0:19305:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1715205913.552535:0:19305:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205913.552536:0:19305:0:(obd_config.c:1497:class_process_config()) marker 4 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1715205913.552538:0:19305:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1715205913.552586:0:19295:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1715205913.552601:0:19295:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1715205913.552611:0:19295:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205913.552620:0:19295:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00000080:01000000:2.0:1715205913.552636:0:19295:0:(llite_lib.c:1471:ll_fill_super()) Found profile lustre-client: mdc=lustre-clilmv osc=lustre-clilov 00000020:00000080:2.0:1715205913.552651:0:19295:0:(genops.c:1312:class_connect()) connect: client 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7, cookie 0x68b86d4dd46f4fe6 00800000:01000000:2.0:1715205913.552667:0:19295:0:(lmv_obd.c:505:lmv_check_connect()) Time to connect 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7 to lustre-clilmv-ffff8800a9d1f000 00800000:01000000:2.0:1715205913.552673:0:19295:0:(lmv_obd.c:345:lmv_connect_mdc()) connect to lustre-MDT0000-mdc-ffff8800a9d1f000(6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) - lustre-MDT0000_UUID, 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7 00000020:00000080:2.0:1715205913.552679:0:19295:0:(genops.c:1312:class_connect()) connect: client 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7, cookie 0x68b86d4dd46f4fed 00000100:00080000:2.0:1715205913.552685:0:19295:0:(import.c:523:import_select_connection()) lustre-MDT0000-mdc-ffff8800a9d1f000: connect to NID 192.168.204.135@tcp last attempt 0 00000100:00080000:2.0:1715205913.552691:0:19295:0:(import.c:615:import_select_connection()) lustre-MDT0000-mdc-ffff8800a9d1f000: import ffff8800a94e9800 using connection 192.168.204.135@tcp/192.168.204.135@tcp 00000008:00100000:2.0:1715205913.552699:0:19295:0:(osc_request.c:3582:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34553605 ocd_grant: 134217728, lost: 0. 00000100:00100000:2.0:1715205913.552713:0:19295:0:(import.c:814:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800aa935500 x1798523513239616/t0(0) o38->lustre-MDT0000-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00080000:2.0:1715205913.552745:0:19295:0:(pinger.c:395:ptlrpc_pinger_add_import()) adding pingable import 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7->lustre-MDT0000_UUID 00000100:00100000:0.0:1715205913.552765:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513239616:192.168.204.135@tcp:38:mount.lustre.0 00000100:00080000:1.0:1715205913.552775:0:297:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1715205913.552779:0:297:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00800000:01000000:2.0:1715205913.552788:0:19295:0:(lmv_obd.c:402:lmv_connect_mdc()) Connected to lustre-MDT0000-mdc-ffff8800a9d1f000(6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) successfully (5) 00800000:00000004:2.0:1715205913.552791:0:19295:0:(obd_class.h:1105:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800a9d1f000: age -737, max_age 0 00000100:00100000:0.0:1715205913.552815:0:2004:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715205913.552820:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2004:1798523513239680:192.168.204.135@tcp:400:kworker.0 00800000:01000000:2.0:1715205913.552833:0:19295:0:(lmv_obd.c:345:lmv_connect_mdc()) connect to lustre-MDT0001-mdc-ffff8800a9d1f000(6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) - lustre-MDT0001_UUID, 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7 00000020:00000080:2.0:1715205913.552838:0:19295:0:(genops.c:1312:class_connect()) connect: client 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7, cookie 0x68b86d4dd46f4ff4 00000100:00080000:2.0:1715205913.552843:0:19295:0:(import.c:523:import_select_connection()) lustre-MDT0001-mdc-ffff8800a9d1f000: connect to NID 192.168.204.135@tcp last attempt 0 00000100:00080000:2.0:1715205913.552854:0:19295:0:(import.c:615:import_select_connection()) lustre-MDT0001-mdc-ffff8800a9d1f000: import ffff8800a94ee800 using connection 192.168.204.135@tcp/192.168.204.135@tcp 00000008:00100000:2.0:1715205913.552859:0:19295:0:(osc_request.c:3582:osc_reconnect()) ocd_connect_flags: 0xae7e5e7be374d3b8 ocd_version: 34553605 ocd_grant: 134217728, lost: 0. 00000100:00100000:3.0:1715205913.552861:0:2006:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715205913.552868:0:19295:0:(import.c:814:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800aa934380 x1798523513239808/t0(0) o38->lustre-MDT0001-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00080000:3.0:1715205913.552871:0:2006:0:(client.c:1702:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8800aa935c00 x1798523513239744/t0(0) o41->lustre-MDT0000-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00080000:2.0:1715205913.552880:0:19295:0:(pinger.c:395:ptlrpc_pinger_add_import()) adding pingable import 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7->lustre-MDT0001_UUID 00000100:00100000:0.0:1715205913.552887:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513239808:192.168.204.135@tcp:38:mount.lustre.0 00000100:00080000:1.0:1715205913.552890:0:297:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1715205913.552893:0:297:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00800000:01000000:2.0:1715205913.552903:0:19295:0:(lmv_obd.c:402:lmv_connect_mdc()) Connected to lustre-MDT0001-mdc-ffff8800a9d1f000(6996bfa2-24ab-4f77-8c1c-5aaba286a5f7) successfully (5) 00800000:00000004:2.0:1715205913.552908:0:19295:0:(obd_class.h:1105:obd_statfs_async()) lustre-MDT0001-mdc-ffff8800a9d1f000: age -737, max_age 0 00000100:00080000:3.0:1715205913.552935:0:2006:0:(client.c:1702:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8800aa935f80 x1798523513239872/t0(0) o41->lustre-MDT0001-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000080:00000004:2.0:1715205913.552935:0:19295:0:(obd_class.h:1136:obd_statfs()) lustre-clilmv-ffff8800a9d1f000: age -737, max_age 262 00800000:00000004:2.0:1715205913.552939:0:19295:0:(obd_class.h:1136:obd_statfs()) lustre-MDT0000-mdc-ffff8800a9d1f000: age -737, max_age 262 00000100:00080000:2.0:1715205913.552951:0:19295:0:(client.c:1702:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8800aa937b80 x1798523513239936/t0(0) o41->lustre-MDT0000-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:2.0:1715205913.552957:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e15b780 going to sleep for 0 seconds 00010000:00080000:0.0:1715205913.553504:0:2004:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa02a680 x1798523513239680/t0(0) o400->lustre-MDT0001-mdc-ffff8800b3e33000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:0.0:1715205913.553511:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f93b71f-777f-44ae-ae8f-53d858e20398:2004:1798523513239680:192.168.204.135@tcp:400:kworker.0 00010000:00080000:0.0:1715205913.553823:0:2003:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa934380 x1798523513239808/t0(0) o38->lustre-MDT0001-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 520/416 e 0 to 0 dl 1715205923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:0.0:1715205913.553831:0:2003:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0001-mdc-ffff8800a9d1f000: committing for last_committed 0 gen 1 00000100:00080000:0.0:1715205913.553836:0:2003:0:(import.c:1087:ptlrpc_connect_interpret()) lustre-MDT0001-mdc-ffff8800a9d1f000: connect to target with instance 1 00000100:00080000:0.0:1715205913.553841:0:2003:0:(import.c:940:ptlrpc_connect_set_flags()) lustre-MDT0001-mdc-ffff8800a9d1f000: Resetting ns_connect_flags to server flags: 0xae7a5e7be344d3b8 00000100:00080000:0.0:1715205913.553848:0:2003:0:(import.c:1168:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1715205913.553850:0:2003:0:(import.c:86:import_set_state_nolock()) ffff8800a94ee800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1715205913.553928:0:2003:0:(recover.c:204:ptlrpc_wake_delayed()) @@@ waking (set ffff8800b5e0e6c0): req@ffff8800aa935f80 x1798523513239872/t0(0) o41->lustre-MDT0001-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:1.0:1715205913.553946:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513239808:192.168.204.135@tcp:38:mount.lustre.0 00000100:00100000:1.0:1715205913.553963:0:2003:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9d1f000: committing for last_committed 0 gen 1 00000100:00080000:1.0:1715205913.553971:0:2003:0:(import.c:1087:ptlrpc_connect_interpret()) lustre-MDT0000-mdc-ffff8800a9d1f000: connect to target with instance 1 00000100:00080000:1.0:1715205913.553975:0:2003:0:(import.c:940:ptlrpc_connect_set_flags()) lustre-MDT0000-mdc-ffff8800a9d1f000: Resetting ns_connect_flags to server flags: 0xae7a5e7be344d3b8 00000100:00080000:1.0:1715205913.553980:0:2003:0:(import.c:1168:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1715205913.553982:0:2003:0:(import.c:86:import_set_state_nolock()) ffff8800a94e9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1715205913.554109:0:2003:0:(recover.c:204:ptlrpc_wake_delayed()) @@@ waking (set ffff88012e15b780): req@ffff8800aa937b80 x1798523513239936/t0(0) o41->lustre-MDT0000-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 224/368 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:0.0:1715205913.554119:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513239616:192.168.204.135@tcp:38:mount.lustre.0 00000100:00100000:2.0:1715205913.554152:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e15b780 going to sleep for 11 seconds 00010000:00080000:3.0:1715205913.554778:0:2006:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa935f80 x1798523513239872/t0(0) o41->lustre-MDT0001-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 224/368 e 0 to 0 dl 1715205929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:3.0:1715205913.554791:0:2006:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa935f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:0:1798523513239872:192.168.204.135@tcp:41:mount.lustre.0 00000100:00100000:3.0:1715205913.554818:0:2006:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa935c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:0:1798523513239744:192.168.204.135@tcp:41:mount.lustre.0 00000100:00100000:0.0:1715205913.554831:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa937b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:19295:1798523513239936:192.168.204.135@tcp:41:mount.lustre.0 00800000:00000004:0.0:1715205913.554843:0:19295:0:(obd_class.h:1162:obd_statfs()) lustre-MDT0000-mdc-ffff8800a9d1f000: update ffff8800a9c89878 cache blocks 321477/353529 objects 1023721/1024000 00000080:00000004:0.0:1715205913.554848:0:19295:0:(obd_class.h:1162:obd_statfs()) lustre-clilmv-ffff8800a9d1f000: update ffff8800a9c8adc8 cache blocks 321477/353529 objects 1023721/1024000 00000080:00100000:0.0:1715205913.554858:0:19295:0:(llite_lib.c:631:client_common_fill_super()) ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 34553605 ocd_grant: 2146304 00020000:01000000:0.0:1715205913.554862:0:19295:0:(lov_obd.c:208:lov_connect()) connect #0 00000020:00000080:0.0:1715205913.554867:0:19295:0:(genops.c:1312:class_connect()) connect: client 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7, cookie 0x68b86d4dd46f4ffb 00000020:00000080:0.0:1715205913.554878:0:19295:0:(genops.c:1312:class_connect()) connect: client LOV_OSC_UUID, cookie 0x68b86d4dd46f5002 00000100:00080000:0.0:1715205913.554882:0:19295:0:(import.c:523:import_select_connection()) lustre-OST0000-osc-ffff8800a9d1f000: connect to NID 192.168.204.135@tcp last attempt 0 00000100:00080000:0.0:1715205913.554887:0:19295:0:(import.c:615:import_select_connection()) lustre-OST0000-osc-ffff8800a9d1f000: import ffff8800a94ef000 using connection 192.168.204.135@tcp/192.168.204.135@tcp 00000008:00100000:0.0:1715205913.554892:0:19295:0:(osc_request.c:3582:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 34553605 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1715205913.554903:0:19295:0:(import.c:814:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800aa971f80 x1798523513240000/t0(0) o8->lustre-OST0000-osc-ffff8800a9d1f000@192.168.204.135@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00080000:0.0:1715205913.554926:0:19295:0:(pinger.c:395:ptlrpc_pinger_add_import()) adding pingable import 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7->lustre-OST0000_UUID 00020000:01000000:0.0:1715205913.554940:0:19295:0:(lov_obd.c:180:lov_connect_osc()) Connected tgt idx 0 lustre-OST0000_UUID (lustre-OST0000-osc-ffff8800a9d1f000) active 00000100:00100000:2.0:1715205913.554944:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513240000:192.168.204.135@tcp:8:mount.lustre.0 00000080:00000004:0.0:1715205913.554951:0:19295:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0x0 -> 0xa0465af2e3640078 00000020:00000080:0.0:1715205913.554960:0:19295:0:(genops.c:1312:class_connect()) connect: client LOV_OSC_UUID, cookie 0x68b86d4dd46f5009 00000100:00080000:0.0:1715205913.554964:0:19295:0:(import.c:523:import_select_connection()) lustre-OST0001-osc-ffff8800a9d1f000: connect to NID 192.168.204.135@tcp last attempt 0 00000100:00080000:0.0:1715205913.554969:0:19295:0:(import.c:615:import_select_connection()) lustre-OST0001-osc-ffff8800a9d1f000: import ffff8800a94ea800 using connection 192.168.204.135@tcp/192.168.204.135@tcp 00000008:00100000:0.0:1715205913.554974:0:19295:0:(osc_request.c:3582:osc_reconnect()) ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 34553605 ocd_grant: 134217728, lost: 0. 00000100:00100000:0.0:1715205913.554983:0:19295:0:(import.c:814:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8800aa973480 x1798523513240064/t0(0) o8->lustre-OST0001-osc-ffff8800a9d1f000@192.168.204.135@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00080000:0.0:1715205913.554994:0:19295:0:(pinger.c:395:ptlrpc_pinger_add_import()) adding pingable import 6996bfa2-24ab-4f77-8c1c-5aaba286a5f7->lustre-OST0001_UUID 00020000:01000000:0.0:1715205913.554998:0:19295:0:(lov_obd.c:180:lov_connect_osc()) Connected tgt idx 1 lustre-OST0001_UUID (lustre-OST0001-osc-ffff8800a9d1f000) active 00000080:00000004:0.0:1715205913.555005:0:19295:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0x0 -> 0xa0465af2e3640078 00000100:00100000:2.0:1715205913.555008:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513240064:192.168.204.135@tcp:8:mount.lustre.0 00000100:00100000:0.0:1715205913.555021:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:19295:1798523513240128:192.168.204.135@tcp:40:mount.lustre.0 00000100:00080000:1.0:1715205913.555042:0:297:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1715205913.555042:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3240 going to sleep for 11 seconds 00000100:00080000:1.0:1715205913.555046:0:297:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715205913.555709:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:19295:1798523513240128:192.168.204.135@tcp:40:mount.lustre.0 00000080:00000004:0.0:1715205913.555719:0:19295:0:(llite_lib.c:710:client_common_fill_super()) rootfid [0x200000007:0x1:0x0] 00000100:00100000:2.0:1715205913.555722:0:2003:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0001-osc-ffff8800a9d1f000: committing for last_committed 0 gen 1 00000100:00080000:2.0:1715205913.555726:0:2003:0:(import.c:1087:ptlrpc_connect_interpret()) lustre-OST0001-osc-ffff8800a9d1f000: connect to target with instance 1 00000100:00080000:2.0:1715205913.555730:0:2003:0:(import.c:940:ptlrpc_connect_set_flags()) lustre-OST0001-osc-ffff8800a9d1f000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440078 00000080:00000004:2.0:1715205913.555735:0:2003:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0465af2e3640078 -> 0xa0425af2e3440078 00000100:00100000:0.0:1715205913.555737:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:19295:1798523513240192:192.168.204.135@tcp:900:mount.lustre.0 00000080:00080000:2.0:1715205913.555740:0:2003:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1715205913.555744:0:2003:0:(import.c:1168:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1715205913.555747:0:2003:0:(import.c:86:import_set_state_nolock()) ffff8800a94ea800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00020000:01000000:2.0:1715205913.555750:0:2003:0:(lov_obd.c:410:lov_set_osc_active()) Marking OSC lustre-OST0001_UUID active 00000080:00000004:2.0:1715205913.555751:0:2003:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1715205913.555753:0:2003:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00100000:2.0:1715205913.555757:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513240064:192.168.204.135@tcp:8:mount.lustre.0 00000100:00100000:0.0:1715205913.555760:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3240 going to sleep for 11 seconds 00010000:00080000:2.0:1715205913.555963:0:2003:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa971f80 x1798523513240000/t0(0) o8->lustre-OST0000-osc-ffff8800a9d1f000@192.168.204.135@tcp:28/4 lens 520/416 e 0 to 0 dl 1715205923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 00000100:00100000:2.0:1715205913.555972:0:2003:0:(client.c:2956:ptlrpc_free_committed()) lustre-OST0000-osc-ffff8800a9d1f000: committing for last_committed 0 gen 1 00000100:00080000:2.0:1715205913.555976:0:2003:0:(import.c:1087:ptlrpc_connect_interpret()) lustre-OST0000-osc-ffff8800a9d1f000: connect to target with instance 1 00000100:00080000:2.0:1715205913.555980:0:2003:0:(import.c:940:ptlrpc_connect_set_flags()) lustre-OST0000-osc-ffff8800a9d1f000: Resetting ns_connect_flags to server flags: 0xa0425af2e3440078 00000080:00000004:2.0:1715205913.555989:0:2003:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1715205913.555992:0:2003:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00080000:2.0:1715205913.555995:0:2003:0:(import.c:1168:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1715205913.555997:0:2003:0:(import.c:86:import_set_state_nolock()) ffff8800a94ef000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00020000:01000000:2.0:1715205913.556000:0:2003:0:(lov_obd.c:410:lov_set_osc_active()) Marking OSC lustre-OST0000_UUID active 00000080:00000004:2.0:1715205913.556002:0:2003:0:(lcommon_misc.c:101:cl_ocd_update()) Changing connect_flags: 0xa0425af2e3440078 -> 0xa0425af2e3440078 00000080:00080000:2.0:1715205913.556004:0:2003:0:(lcommon_misc.c:74:cl_init_ea_size()) updating def/max_easize: 72/65536 00000100:00100000:2.0:1715205913.556009:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2003:1798523513240000:192.168.204.135@tcp:8:mount.lustre.0 00000100:00100000:0.0:1715205913.556495:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:19295:1798523513240192:192.168.204.135@tcp:900:mount.lustre.0 00000100:00100000:0.0:1715205913.556523:0:19295:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:19295:1798523513240256:192.168.204.135@tcp:33:mount.lustre.0 00000100:00100000:0.0:1715205913.556552:0:19295:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3240 going to sleep for 11 seconds 00000100:00100000:0.0:1715205913.557323:0:19295:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:19295:1798523513240256:192.168.204.135@tcp:33:mount.lustre.0 00000080:00200000:0.0:1715205913.557339:0:19295:0:(llite_lib.c:3140:ll_read_inode2()) VFS Op:inode=[0x200000007:0x1:0x0](ffff88012f2688c8) 00000080:00200000:0.0:1715205913.557355:0:19295:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096 00000080:02000400:0.0:1715205913.557421:0:19295:0:(llite_lib.c:1512:ll_fill_super()) Mounted lustre-client 00000080:00000004:0.0:1715205913.558413:0:19295:0:(super25.c:192:lustre_fill_super()) 192.168.204.135@tcp:/lustre: Mount complete 00010000:00010000:0.0:1715205913.805868:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205914.095516:0:19534:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg435-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1715205914.807953:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205915.809962:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205916.812141:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205917.814005:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1715205918.559893:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1715205918.559898:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 4f93b71f-777f-44ae-ae8f-53d858e20398->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715205918.559905:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513240320:192.168.204.135@tcp:400:kworker.0 00000100:00100000:1.0:1715205918.559934:0:2005:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f93b71f-777f-44ae-ae8f-53d858e20398:2005:1798523513240384:192.168.204.135@tcp:400:kworker.0 00000100:00100000:1.0:1715205918.559965:0:2005:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2005:1798523513240512:192.168.204.135@tcp:400:kworker.0 00000100:00100000:0.0:1715205918.559968:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2004:1798523513240448:192.168.204.135@tcp:400:kworker.0 00000100:00100000:0.0:1715205918.559980:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2004:1798523513240576:192.168.204.135@tcp:400:kworker.0 00000100:00100000:1.0:1715205918.559985:0:2005:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2005:1798523513240640:192.168.204.135@tcp:400:kworker.0 00000100:00100000:0.0:1715205918.561151:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513240320:192.168.204.135@tcp:400:kworker.0 00000100:00100000:0.0:1715205918.561171:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2004:1798523513240448:192.168.204.135@tcp:400:kworker.0 00010000:00080000:1.0:1715205918.561173:0:2005:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa02b480 x1798523513240384/t0(0) o400->lustre-MDT0001-mdc-ffff8800b3e33000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00010000:00080000:0.0:1715205918.561180:0:2004:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa02b800 x1798523513240576/t0(0) o400->lustre-OST0000-osc-ffff8800a9d1f000@192.168.204.135@tcp:28/4 lens 224/224 e 0 to 0 dl 1715205934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:1.0:1715205918.561185:0:2005:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f93b71f-777f-44ae-ae8f-53d858e20398:2005:1798523513240384:192.168.204.135@tcp:400:kworker.0 00000100:00100000:0.0:1715205918.561189:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2004:1798523513240576:192.168.204.135@tcp:400:kworker.0 00010000:00080000:1.0:1715205918.561195:0:2005:0:(ldlm_request.c:1540:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46624) req@ffff8800aa02ad80 x1798523513240512/t0(0) o400->lustre-MDT0001-mdc-ffff8800a9d1f000@192.168.204.135@tcp:12/10 lens 224/224 e 0 to 0 dl 1715205934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 00000100:00100000:1.0:1715205918.561203:0:2005:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2005:1798523513240512:192.168.204.135@tcp:400:kworker.0 00000100:00100000:1.0:1715205918.561211:0:2005:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6996bfa2-24ab-4f77-8c1c-5aaba286a5f7:2005:1798523513240640:192.168.204.135@tcp:400:kworker.0 00000001:02000400:3.0:1715205918.801458:0:20196:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1715205918.815899:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715205919.662724:0:1998:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.135@tcp (source: 12345-192.168.204.135@tcp) 00000100:00100000:3.0:1715205919.662782:0:1998:0:(events.c:359:request_in_callback()) peer: 12345-192.168.204.135@tcp (source: 12345-192.168.204.135@tcp) 00000100:00100000:2.0:1715205919.662826:0:5356:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523518519360 00000100:00100000:2.0:1715205919.662835:0:5356:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523518519360 00000100:00100000:3.0:1715205919.662838:0:5357:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523518519424 00000100:00100000:3.0:1715205919.662842:0:5357:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523518519424 00000100:00100000:3.0:1715205919.662867:0:5357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.135@tcp, seq: 10 00000100:00100000:3.0:1715205919.662873:0:5357:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8+4:26640:x1798523518519360:12345-192.168.204.135@tcp:104: 00010000:00010000:3.0:1715205919.662886:0:5357:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205919.662946:0:5357:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1715205919.662953:0:5357:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8+4:26640:x1798523518519360:12345-192.168.204.135@tcp:104: Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205919.662959:0:5357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.135@tcp, seq: 10 00000100:00100000:3.0:1715205919.662973:0:5357:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.135@tcp, seq: 11 00000100:00100000:3.0:1715205919.662978:0:5357:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8+3:26640:x1798523518519424:12345-192.168.204.135@tcp:104: 00010000:00010000:0.0:1715205919.662980:0:5876:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205919.662983:0:5357:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205919.662986:0:5876:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205919.662993:0:5876:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa976400 already unused, calling callback (ffffffffa04cea40) 10000000:00010000:0.0:1715205919.662996:0:5876:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205919.663003:0:5876:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715205919.663008:0:5876:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205919.663015:0:5357:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:0.0:1715205919.663019:0:5876:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1715205919.663021:0:5357:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d7e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8+3:26640:x1798523518519424:12345-192.168.204.135@tcp:104: Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205919.663027:0:5357:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.135@tcp, seq: 11 00010000:00010000:0.0:1715205919.663048:0:5876:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205919.663053:0:5876:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205919.663062:0:5365:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715205919.663069:0:5876:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205919.663074:0:5365:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205919.663075:0:5876:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff8800aa976400/0x68b86d4dd46f4fdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a9778114f3 expref: -99 pid: 19295 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205919.663081:0:5365:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa9761c0 already unused, calling callback (ffffffffa04cea40) 10000000:00010000:1.0:1715205919.663084:0:5365:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205919.663090:0:5365:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205919.663095:0:5365:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205919.663095:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205919.663096:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205919.663098:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1715205919.663099:0:5365:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1715205919.663110:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513240704:192.168.204.135@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715205919.663125:0:5365:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205919.663130:0:5365:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205919.663138:0:5365:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205919.663143:0:5365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.135@tcp lock: ffff8800aa9761c0/0x68b86d4dd46f4f84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4cb6a6a9778114de expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205919.663150:0:2004:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715205919.663156:0:2004:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513240768:192.168.204.135@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715205919.663159:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205919.663160:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205919.663162:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205919.663945:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513240704:192.168.204.135@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1715205919.663983:0:2004:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa028000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:2004:1798523513240768:192.168.204.135@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715205919.817936:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:0.0:1715205920.701684:0:18662:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:0.0:1715205920.701705:0:18662:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205920.701749:0:18662:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701757:0:18662:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701770:0:18662:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00000100:00100000:0.0:1715205920.701781:0:18662:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3b40 going to sleep for 0 seconds 00000100:00100000:0.0:1715205920.701789:0:18662:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:18662:1798523513240832:192.168.204.135@tcp:101:bash.0 00010000:00010000:0.0:1715205920.701797:0:18662:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701828:0:18662:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701832:0:18662:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701836:0:18662:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701840:0:18662:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701844:0:18662:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa976ac0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:0.0:1715205920.701846:0:18662:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701850:0:18662:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701853:0:18662:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701857:0:18662:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205920.701860:0:18662:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.701867:0:18662:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976ac0/0x68b86d4dd46f5010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00000080:00020000:0.0:1715205920.701882:0:18662:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715205920.706532:0:18662:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:0.0:1715205920.706551:0:18662:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715205920.706588:0:18662:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706596:0:18662:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706604:0:18662:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00000100:00100000:0.0:1715205920.706617:0:18662:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3b40 going to sleep for 0 seconds 00000100:00100000:0.0:1715205920.706626:0:18662:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:18662:1798523513240896:192.168.204.135@tcp:101:bash.0 00010000:00010000:0.0:1715205920.706634:0:18662:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706639:0:18662:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706645:0:18662:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706649:0:18662:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706653:0:18662:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706666:0:18662:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa976d00 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:0.0:1715205920.706669:0:18662:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706672:0:18662:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706676:0:18662:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706680:0:18662:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715205920.706683:0:18662:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00010000:00010000:0.0:1715205920.706686:0:18662:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa976d00/0x68b86d4dd46f5017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 18662 initiator: MDT0 00000080:00020000:0.0:1715205920.706699:0:18662:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205920.709170:0:20625:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205920.709184:0:20625:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205920.709208:0:20625:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709231:0:20625:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709243:0:20625:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00000100:00100000:1.0:1715205920.709254:0:20625:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24f00 going to sleep for 0 seconds 00000100:00100000:1.0:1715205920.709260:0:20625:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:20625:1798523513240960:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205920.709267:0:20625:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709272:0:20625:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709277:0:20625:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709283:0:20625:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709288:0:20625:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709293:0:20625:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa930b40 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205920.709296:0:20625:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709300:0:20625:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709305:0:20625:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709309:0:20625:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205920.709312:0:20625:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709321:0:20625:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa930b40/0x68b86d4dd46f501e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00000080:00020000:1.0:1715205920.709336:0:20625:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205920.709367:0:20625:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205920.709374:0:20625:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205920.709389:0:20625:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709395:0:20625:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709401:0:20625:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00000100:00100000:1.0:1715205920.709409:0:20625:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24f00 going to sleep for 0 seconds 00000100:00100000:1.0:1715205920.709413:0:20625:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:20625:1798523513241024:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205920.709419:0:20625:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709424:0:20625:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709429:0:20625:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709434:0:20625:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709439:0:20625:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709451:0:20625:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa933180 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205920.709454:0:20625:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709459:0:20625:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709465:0:20625:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709469:0:20625:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205920.709472:0:20625:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709477:0:20625:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa933180/0x68b86d4dd46f5025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00000080:00020000:1.0:1715205920.709489:0:20625:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205920.709766:0:20625:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205920.709775:0:20625:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205920.709792:0:20625:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709798:0:20625:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709826:0:20625:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00000100:00100000:1.0:1715205920.709836:0:20625:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24f00 going to sleep for 0 seconds 00000100:00100000:1.0:1715205920.709841:0:20625:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:20625:1798523513241088:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205920.709847:0:20625:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709857:0:20625:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709862:0:20625:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709868:0:20625:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709874:0:20625:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709878:0:20625:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa932f40 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205920.709881:0:20625:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709886:0:20625:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709892:0:20625:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709897:0:20625:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205920.709900:0:20625:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709905:0:20625:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932f40/0x68b86d4dd46f502c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00000080:00020000:1.0:1715205920.709920:0:20625:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205920.709929:0:20625:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205920.709935:0:20625:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205920.709954:0:20625:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709960:0:20625:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709966:0:20625:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00000100:00100000:1.0:1715205920.709974:0:20625:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24f00 going to sleep for 0 seconds 00000100:00100000:1.0:1715205920.709978:0:20625:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:20625:1798523513241152:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205920.709983:0:20625:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709988:0:20625:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709993:0:20625:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.709999:0:20625:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710004:0:20625:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710008:0:20625:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa931680 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205920.710011:0:20625:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710015:0:20625:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710020:0:20625:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710030:0:20625:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205920.710033:0:20625:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710038:0:20625:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa931680/0x68b86d4dd46f5033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00000080:00020000:1.0:1715205920.710051:0:20625:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205920.710101:0:20625:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205920.710109:0:20625:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205920.710124:0:20625:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710130:0:20625:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710136:0:20625:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00000100:00100000:1.0:1715205920.710144:0:20625:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24f00 going to sleep for 0 seconds 00000100:00100000:1.0:1715205920.710149:0:20625:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:20625:1798523513241216:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205920.710155:0:20625:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710160:0:20625:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710165:0:20625:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710170:0:20625:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710179:0:20625:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710184:0:20625:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa932ac0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205920.710186:0:20625:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710190:0:20625:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710195:0:20625:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710199:0:20625:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205920.710202:0:20625:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710206:0:20625:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932ac0/0x68b86d4dd46f503a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00000080:00020000:1.0:1715205920.710234:0:20625:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715205920.710243:0:20625:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:1.0:1715205920.710249:0:20625:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715205920.710265:0:20625:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710271:0:20625:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710276:0:20625:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00000100:00100000:1.0:1715205920.710284:0:20625:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9e24f00 going to sleep for 0 seconds 00000100:00100000:1.0:1715205920.710294:0:20625:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:20625:1798523513241280:192.168.204.135@tcp:101:rm.0 00010000:00010000:1.0:1715205920.710300:0:20625:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710305:0:20625:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710309:0:20625:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710314:0:20625:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710320:0:20625:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710324:0:20625:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa932d00 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:1.0:1715205920.710327:0:20625:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710332:0:20625:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710337:0:20625:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710341:0:20625:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715205920.710344:0:20625:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00010000:00010000:1.0:1715205920.710349:0:20625:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa932d00/0x68b86d4dd46f5041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20625 initiator: MDT0 00000080:00020000:1.0:1715205920.710362:0:20625:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:1.0:1715205920.819948:0:5876:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1715205921.633900:0:5367:0:(mgc_request.c:626:do_requeue()) updating log params 10000000:01000000:3.0:1715205921.633905:0:5367:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff8800a9d1f000 from 10 10000000:01000000:3.0:1715205921.633909:0:5367:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1715205921.633942:0:5367:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa95f600/0x68b86d4dd46f5048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205921.633950:0:5367:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff8800aa95f600/0x68b86d4dd46f5048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205921.633966:0:5367:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff8800aa95f600/0x68b86d4dd46f5048 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205921.633986:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241344:192.168.204.135@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1715205921.634050:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfabcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1715205921.635091:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241344:192.168.204.135@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1715205921.635104:0:5367:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff8800aa95f600/0x68b86d4dd46f5048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a977811555 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205921.635112:0:5367:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff8800aa95f600/0x68b86d4dd46f5048 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a977811555 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205921.635147:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241408:192.168.204.135@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1715205921.635172:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfabcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1715205921.635776:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241408:192.168.204.135@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1715205921.635794:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241472:192.168.204.135@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715205921.635841:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfabcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1715205921.636542:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241472:192.168.204.135@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1715205921.636711:0:21036:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21036:1798523513241536:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205921.636751:0:21036:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dbc1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1715205921.637412:0:21036:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21036:1798523513241536:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205921.637431:0:21036:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205921.637438:0:21036:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205921.637440:0:21036:0:(obd_config.c:1497:class_process_config()) marker 5 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1715205921.637444:0:21036:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff8800a9d1f000 00000020:00000080:1.0:1715205921.637446:0:21036:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1715205921.637500:0:21036:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21036:1798523513241600:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205921.637538:0:21036:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dbc1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1715205921.638187:0:21036:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21036:1798523513241600:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205921.638213:0:21036:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715205921.638216:0:21036:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205921.638217:0:21036:0:(obd_config.c:1497:class_process_config()) marker 5 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1715205921.638220:0:21036:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1715205921.638245:0:5367:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1715205921.638257:0:5367:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1715205921.638263:0:5367:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa95f600/0x68b86d4dd46f5048 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a977811555 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205921.638271:0:5367:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff8800aa95f600/0x68b86d4dd46f5048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a977811555 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715205921.638282:0:5367:0:(mgc_request.c:626:do_requeue()) updating log params 10000000:01000000:3.0:1715205921.638284:0:5367:0:(mgc_request.c:1762:mgc_process_log()) Process log params-ffff8800b3e33000 from 10 10000000:01000000:3.0:1715205921.638286:0:5367:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1715205921.638300:0:5367:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa95fcc0/0x68b86d4dd46f504f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205921.638306:0:5367:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.135@tcp lock: ffff8800aa95fcc0/0x68b86d4dd46f504f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205921.638313:0:5367:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.135@tcp lock: ffff8800aa95fcc0/0x68b86d4dd46f504f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205921.638323:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241664:192.168.204.135@tcp:101:ll_cfg_requeue.0 00000100:00100000:3.0:1715205921.638353:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfabcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1715205921.638961:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241664:192.168.204.135@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1715205921.638973:0:5367:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.135@tcp lock: ffff8800aa95fcc0/0x68b86d4dd46f504f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a97781155c expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205921.638981:0:5367:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.135@tcp lock: ffff8800aa95fcc0/0x68b86d4dd46f504f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4cb6a6a97781155c expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205921.639012:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241728:192.168.204.135@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1715205921.639046:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3840 going to sleep for 11 seconds 00000100:00100000:0.0:1715205921.639735:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241728:192.168.204.135@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1715205921.639759:0:5367:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241792:192.168.204.135@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1715205921.639819:0:5367:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a9fe3840 going to sleep for 11 seconds 00000100:00100000:0.0:1715205921.640552:0:5367:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa973100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:5367:1798523513241792:192.168.204.135@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1715205921.640737:0:21039:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21039:1798523513241856:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205921.640772:0:21039:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dbc1780 going to sleep for 11 seconds 00000100:00100000:1.0:1715205921.641432:0:21039:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21039:1798523513241856:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715205921.641449:0:21039:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715205921.641454:0:21039:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715205921.641455:0:21039:0:(obd_config.c:1497:class_process_config()) marker 5 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1715205921.641457:0:21039:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce032, instance name: general-ffff8800b3e33000 00000020:00000080:1.0:1715205921.641459:0:21039:0:(obd_config.c:1409:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1715205921.641500:0:21039:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21039:1798523513241920:192.168.204.135@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715205921.641538:0:21039:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012dbc1780 going to sleep for 11 seconds 00000100:00100000:0.0:1715205921.642134:0:21039:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aa02ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13bd8ebe-30a8-40d5-b37d-8e600c74dbe8:21039:1798523513241920:192.168.204.135@tcp:502:llog_process_th.0 00000020:01000000:0.0:1715205921.642156:0:21039:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1715205921.642159:0:21039:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1715205921.642161:0:21039:0:(obd_config.c:1497:class_process_config()) marker 5 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1715205921.642164:0:21039:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1715205921.642235:0:5367:0:(obd_config.c:2079:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1715205921.642252:0:5367:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.204.135@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1715205921.642258:0:5367:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.135@tcp lock: ffff8800aa95fcc0/0x68b86d4dd46f504f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a97781155c expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205921.642266:0:5367:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.135@tcp lock: ffff8800aa95fcc0/0x68b86d4dd46f504f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4cb6a6a97781155c expref: -99 pid: 5367 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205921.821904:0:5365:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205922.738331:0:21274:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-dom test complete, duration 164 sec ============ 18:05:22 (1715205922) 00000080:00200000:3.0:1715205922.784105:0:7497:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:3.0:1715205922.784126:0:7497:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205922.784170:0:7497:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784195:0:7497:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784202:0:7497:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7497 initiator: MDT0 00000100:00100000:3.0:1715205922.784217:0:7497:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfabd80 going to sleep for 0 seconds 00000100:00100000:3.0:1715205922.784226:0:7497:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7b80 pname:cluuid:pid:xid:nid:opc:job bash:4f93b71f-777f-44ae-ae8f-53d858e20398:7497:1798523513241984:192.168.204.135@tcp:101:bash.0 00010000:00010000:3.0:1715205922.784234:0:7497:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784246:0:7497:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784252:0:7497:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784257:0:7497:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784262:0:7497:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784267:0:7497:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa95fa80 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:3.0:1715205922.784270:0:7497:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784275:0:7497:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784280:0:7497:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784285:0:7497:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205922.784289:0:7497:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7497 initiator: MDT0 00010000:00010000:3.0:1715205922.784293:0:7497:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95fa80/0x68b86d4dd46f5056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 7497 initiator: MDT0 00000080:00020000:3.0:1715205922.784311:0:7497:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715205922.786051:0:21306:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:3.0:1715205922.786060:0:21306:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205922.786078:0:21306:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786084:0:21306:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786089:0:21306:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21306 initiator: MDT0 00000100:00100000:3.0:1715205922.786096:0:21306:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfab240 going to sleep for 0 seconds 00000100:00100000:3.0:1715205922.786101:0:21306:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7b80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:21306:1798523513242048:192.168.204.135@tcp:101:rm.0 00010000:00010000:3.0:1715205922.786106:0:21306:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786110:0:21306:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786115:0:21306:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786119:0:21306:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786123:0:21306:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786128:0:21306:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa95f840 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:3.0:1715205922.786129:0:21306:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786134:0:21306:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786138:0:21306:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786145:0:21306:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205922.786148:0:21306:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786152:0:21306:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f840/0x68b86d4dd46f505d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21306 initiator: MDT0 00000080:00020000:3.0:1715205922.786163:0:21306:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715205922.786204:0:21306:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b0a680c8),name=/ 00000002:00010000:3.0:1715205922.786210:0:21306:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715205922.786223:0:21306:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786228:0:21306:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786234:0:21306:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21306 initiator: MDT0 00000100:00100000:3.0:1715205922.786240:0:21306:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800abfab240 going to sleep for 0 seconds 00000100:00100000:3.0:1715205922.786244:0:21306:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012d7e7b80 pname:cluuid:pid:xid:nid:opc:job rm:4f93b71f-777f-44ae-ae8f-53d858e20398:21306:1798523513242112:192.168.204.135@tcp:101:rm.0 00010000:00010000:3.0:1715205922.786248:0:21306:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786253:0:21306:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786257:0:21306:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786261:0:21306:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786270:0:21306:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786274:0:21306:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa95f3c0 already unused, calling callback (ffffffffa1047e10) 00010000:00010000:3.0:1715205922.786276:0:21306:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786280:0:21306:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786284:0:21306:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786288:0:21306:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715205922.786290:0:21306:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21306 initiator: MDT0 00010000:00010000:3.0:1715205922.786294:0:21306:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b3e33000 lock: ffff8800aa95f3c0/0x68b86d4dd46f5064 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21306 initiator: MDT0 00000080:00020000:3.0:1715205922.786304:0:21306:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715205922.823855:0:16624:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715205923.122453:0:21440:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-dom : @@@@@@ FAIL: remove sub-test dirs failed Debug log: 1489 lines, 1489 kept, 0 dropped, 0 bad.