00010000:00010000:2.0F:1717018955.866687:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018956.869513:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018957.870704:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1717018958.400743:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838677376:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018958.400743:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838677312:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018958.400797:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838677504:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018958.400797:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838677440:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018958.402355:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838677376:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018958.402361:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838677504:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018958.402401:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838677312:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018958.402410:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838677440:192.168.203.126@tcp:400:kworker/u8:0.0 00000400:00000080:3.0:1717018958.690001:0:25673:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1717018958.690004:0:25673:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 23c: Append with low on space + 0-length comp: force extension ========================================================== 17:42:38 (1717018958) 00000080:00200000:1.0F:1717018958.786750:0:25537:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018958.786772:0:25537:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018958.786783:0:25537:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.786792:0:25537:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018958.786800:0:25537:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018958.786802:0:25537:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018958.786806:0:25537:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff88012c7bfaf8 00010000:00010000:1.0:1717018958.786808:0:25537:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.786813:0:25537:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018958.786824:0:25537:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018958.786831:0:25537:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1 00000080:00200000:1.0:1717018958.786833:0:25537:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=getattr 00000002:00010000:1.0:1717018958.786838:0:25537:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1717018958.786865:0:25537:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.786870:0:25537:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.786876:0:25537:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018958.786892:0:25537:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:25537:1800422838677568:192.168.203.126@tcp:101:bash.0 00000100:00100000:1.0:1717018958.786942:0:25537:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 80 seconds 00000100:00100000:1.0:1717018958.789535:0:25537:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:25537:1800422838677568:192.168.203.126@tcp:101:bash.0 00010000:00010000:1.0:1717018958.789551:0:25537:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789561:0:25537:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789566:0:25537:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789571:0:25537:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789576:0:25537:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789605:0:25537:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f22880 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:1.0:1717018958.789608:0:25537:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789613:0:25537:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789617:0:25537:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789621:0:25537:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1717018958.789624:0:25537:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789636:0:25537:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f22880/0xe1aedd3f13a3682d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018958.789648:0:25537:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a93e1c80 x1800422838677568/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019039 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:1.0:1717018958.789671:0:25537:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:1.0:1717018958.789791:0:25537:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018958.789800:0:25537:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1717018958.789804:0:25537:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:1.0:1717018958.789828:0:25537:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789833:0:25537:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.789839:0:25537:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018958.789853:0:25537:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:25537:1800422838677632:192.168.203.126@tcp:101:bash.0 00000100:00100000:1.0:1717018958.789896:0:25537:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 80 seconds 00000100:00100000:1.0:1717018958.791636:0:25537:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:25537:1800422838677632:192.168.203.126@tcp:101:bash.0 00010000:00010000:1.0:1717018958.791651:0:25537:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791659:0:25537:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791677:0:25537:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791684:0:25537:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791690:0:25537:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791694:0:25537:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791698:0:25537:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018958.791704:0:25537:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a93e1c80 x1800422838677632/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1717019039 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:1.0:1717018958.791711:0:25537:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791717:0:25537:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1717018958.791740:0:25537:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 14848 00000080:00010000:1.0:1717018958.791744:0:25537:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a36834 00000080:00010000:1.0:1717018958.791748:0:25537:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018958.791750:0:25537:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36834 from it ffff88012c7bfcf8 00010000:00010000:1.0:1717018958.791752:0:25537:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.791762:0:25537:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018958.795310:0:25697:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018958.795325:0:25697:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018958.795335:0:25697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.795346:0:25697:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018958.795356:0:25697:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018958.795358:0:25697:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018958.795363:0:25697:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8683b58 00010000:00010000:1.0:1717018958.795364:0:25697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.795369:0:25697:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018958.795380:0:25697:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018958.795387:0:25697:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1536 00000080:00200000:1.0:1717018958.795389:0:25697:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018958.795781:0:25697:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018958.795786:0:25697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.795792:0:25697:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018958.795802:0:25697:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018958.795804:0:25697:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018958.795807:0:25697:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8683bf8 00010000:00010000:1.0:1717018958.795808:0:25697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.795813:0:25697:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018958.795819:0:25697:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717018958.795822:0:25697:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018958.795825:0:25697:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018958.795828:0:25697:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.795832:0:25697:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018958.795837:0:25697:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018958.795838:0:25697:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018958.795840:0:25697:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8683da0 00010000:00010000:1.0:1717018958.795841:0:25697:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.795844:0:25697:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018958.795849:0:25697:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717018958.795855:0:25697:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8) 00010000:00010000:1.0:1717018958.795964:0:25697:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.795978:0:25697:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.796009:0:25697:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018958.796014:0:25697:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018958.796015:0:25697:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36834 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1cb4 expref: -99 pid: 25537 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1717018958.796027:0:25697:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1717018958.796035:0:25697:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a93e1c80 x1800422838677760/t0(0) o36->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1717018958.796051:0:25697:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:25697:1800422838677760:192.168.203.126@tcp:36:mkdir.0 00000100:00100000:1.0:1717018958.796116:0:25697:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 80 seconds 00000100:00100000:1.0:1717018958.801699:0:25697:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:25697:1800422838677760:192.168.203.126@tcp:36:mkdir.0 00000080:00200000:1.0:1717018958.801942:0:25697:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cf6:0x0](ffff880136ed7518) 00000080:00200000:1.0:1717018958.801946:0:25697:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cf6:0x0], updating i_size 512 00010000:00010000:1.0:1717018958.872776:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018959.875070:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018960.877986:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018961.878853:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018962.880847:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018963.409114:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838677824:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018963.409114:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838677888:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018963.409164:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678016:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018963.409167:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838677952:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018963.412252:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89704c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678016:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018963.412274:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838677888:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018963.412288:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838677824:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018963.412298:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838677952:192.168.203.126@tcp:400:kworker/u8:0.0 00010000:00010000:1.0:1717018963.882758:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018964.884770:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018965.886888:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018966.888834:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018967.891491:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018968.416766:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678144:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018968.416821:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678272:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018968.416844:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018968.416848:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838678080:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018968.416875:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678208:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018968.418618:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838678080:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018968.418632:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678208:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018968.418641:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678144:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:3.0:1717018968.418647:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838678272:192.168.203.126@tcp:400:kworker/u8:0.0 00000100:00100000:2.0:1717018968.638251:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018968.639649:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:1.0:1717018968.640129:0:10301:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819917824 00000100:00100000:1.0:1717018968.640196:0:10301:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 2692 00000100:00100000:1.0:1717018968.640202:0:10301:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a89717c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:461e9689-0dac-4669-87c3-00abdddc539f+3:31352:x1800422819917824:12345-192.168.203.126@tcp:104: 00010000:00010000:1.0:1717018968.640274:0:10301:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1717018968.640289:0:10301:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a89717c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:461e9689-0dac-4669-87c3-00abdddc539f+3:31352:x1800422819917824:12345-192.168.203.126@tcp:104: Request processed in 87us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018968.640295:0:10301:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 2692 00010000:00010000:1.0:1717018968.640313:0:4630:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717018968.640317:0:4630:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f21b00/0xe1aedd3f13a367cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1b64 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.640325:0:4630:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f21b00 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717018968.640327:0:4630:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f21b00/0xe1aedd3f13a367cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1b64 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.640333:0:4630:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f21b00/0xe1aedd3f13a367cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1b64 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018968.640337:0:4630:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f21b00/0xe1aedd3f13a367cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1b64 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018968.640341:0:4630:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1717018968.640356:0:10294:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1717018968.640365:0:4630:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f21b00/0xe1aedd3f13a367cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1b64 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.640369:0:4630:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1717018968.640376:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819917760 00010000:00010000:1.0:1717018968.640380:0:4630:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f21b00/0xe1aedd3f13a367cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1b64 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.640384:0:4630:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f21b00/0xe1aedd3f13a367cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1b64 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.640396:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018968.640397:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018968.640398:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018968.640406:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77874 00000100:00100000:3.0:1717018968.640410:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aaf01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+3:31352:x1800422819917760:12345-192.168.203.126@tcp:104: 00000100:00100000:1.0:1717018968.640442:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838678336:192.168.203.126@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1717018968.640451:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018968.640462:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aaf01050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+3:31352:x1800422819917760:12345-192.168.203.126@tcp:104: Request processed in 51us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018968.640467:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77874 00010000:00010000:1.0:1717018968.640497:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717018968.640499:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a367d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1b6b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.640504:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f233c0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:1.0:1717018968.640505:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a367d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1b6b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.640510:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a367d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1b6b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018968.640769:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a367d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1b6b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018968.640773:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018968.641413:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a367d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1b6b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.641418:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018968.641427:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a367d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1b6b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.641431:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a367d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1b6b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018968.641440:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018968.641441:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018968.641443:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018968.641451:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838678400:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:1.0:1717018968.642677:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838678336:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1717018968.645039:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838678400:192.168.203.126@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1717018968.895307:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018969.896873:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717018970.280610:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018970.280615:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 119 10000000:01000000:2.0:1717018970.280618:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018970.280650:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018970.280657:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018970.280664:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018970.280683:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678464:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018970.280861:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880180 going to sleep for 6 seconds 00000100:00100000:0.0F:1717018970.284029:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678464:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018970.284062:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018970.284070:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018970.284127:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678528:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018970.284173:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018970.287258:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678528:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018970.287319:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678592:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018970.287403:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018970.292652:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678592:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018970.293075:0:25885:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25885:1800422838678656:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018970.293176:0:25885:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892fc00 going to sleep for 6 seconds 00000100:00100000:1.0:1717018970.297066:0:25885:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25885:1800422838678656:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018970.297115:0:25885:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018970.297125:0:25885:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018970.297126:0:25885:0:(obd_config.c:1460:class_process_config()) marker 78 (0x1) lustre-clilov new lustre.test_23c 00000020:01000000:1.0:1717018970.297131:0:25885:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018970.297133:0:25885:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1717018970.297153:0:25885:0:(lov_pool.c:313:lov_pool_new()) test_23c is pool #2 00000100:00100000:1.0:1717018970.297188:0:25885:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25885:1800422838678720:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018970.297989:0:25885:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892ff00 going to sleep for 6 seconds 00000100:00100000:1.0:1717018970.302384:0:25885:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25885:1800422838678720:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018970.302435:0:25885:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018970.302444:0:25885:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018970.302446:0:25885:0:(obd_config.c:1460:class_process_config()) marker 78 (0x2) lustre-clilov new lustre.test_23c 00000040:00080000:1.0:1717018970.302450:0:25885:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 122 count 120 00000020:01000000:0.0:1717018970.303727:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 119-121 (rc=0) 10000000:01000000:0.0:1717018970.303758:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018970.303765:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018970.303777:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018970.303957:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018970.304081:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:0.0:1717018970.304083:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018970.304115:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018970.304121:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018970.304149:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018970.304170:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678784:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018970.304249:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018970.308088:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678784:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018970.308308:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018970.308320:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018970.308397:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678848:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018970.308465:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b00c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018970.310792:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838678848:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018970.310839:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018970.310847:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018970.310856:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018970.898916:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018971.388836:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018971.388887:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018971.388918:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819921536 00000100:00100000:2.0:1717018971.388919:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819921472 00000100:00100000:3.0:1717018971.388958:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77875 00000100:00100000:3.0:1717018971.388964:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a25580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:31568:x1800422819921536:12345-192.168.203.126@tcp:104: 00000100:00100000:2.0:1717018971.388977:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77876 00000100:00100000:2.0:1717018971.388982:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a25a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+4:31568:x1800422819921472:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018971.389055:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018971.389111:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a25580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:31568:x1800422819921536:12345-192.168.203.126@tcp:104: Request processed in 147us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018971.389119:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77875 00010000:00010000:2.0:1717018971.389387:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1717018971.389394:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a25a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:461e9689-0dac-4669-87c3-00abdddc539f+3:31568:x1800422819921472:12345-192.168.203.126@tcp:104: Request processed in 411us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018971.389404:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77876 00010000:00010000:0.0:1717018971.389464:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717018971.389468:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389477:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809fa80 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018971.389489:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389495:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018971.389500:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018971.389503:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018971.389531:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389536:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018971.389550:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389554:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809fa80/0xe1aedd3f13a3683b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1cec expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389574:0:10278:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018971.389575:0:10278:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389579:0:10278:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8938900 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018971.389580:0:10278:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389603:0:10278:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018971.389606:0:10278:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018971.389617:0:10278:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018971.389627:0:10278:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389631:0:10278:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018971.389635:0:10278:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389638:0:10278:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8938900/0xe1aedd3f13a36842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1cf3 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.389648:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018971.389649:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018971.389650:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018971.389659:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018971.389771:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838678912:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1717018971.389813:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1717018971.389818:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838678976:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1717018971.390927:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838678912:192.168.203.126@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1717018971.391999:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838678976:192.168.203.126@tcp:103:ldlm_bl_04.0 10000000:01000000:0.0:1717018971.540684:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717018971.540690:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 122 10000000:01000000:0.0:1717018971.540694:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717018971.540727:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.540735:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.540757:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36849 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018971.540777:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679040:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018971.540851:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018971.543849:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679040:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018971.543871:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1d47 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.543879:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36849 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1d47 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018971.543936:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679104:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018971.543989:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018971.547828:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679104:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018971.548021:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679168:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018971.548100:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018971.551045:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679168:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018971.551508:0:25929:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25929:1800422838679232:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018971.551623:0:25929:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892fe40 going to sleep for 6 seconds 00000100:00100000:1.0:1717018971.554138:0:25929:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25929:1800422838679232:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018971.554172:0:25929:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018971.554179:0:25929:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018971.554180:0:25929:0:(obd_config.c:1460:class_process_config()) marker 80 (0x1) lustre-clilov add lustre.test_23c.lustre-OST0000_UUID 00000020:01000000:1.0:1717018971.554189:0:25929:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018971.554191:0:25929:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1717018971.554198:0:25929:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_23c as member 1 00000100:00100000:1.0:1717018971.554220:0:25929:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25929:1800422838679296:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018971.554285:0:25929:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892fe40 going to sleep for 6 seconds 00000100:00100000:1.0:1717018971.555820:0:25929:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:25929:1800422838679296:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018971.555843:0:25929:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018971.555847:0:25929:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018971.555848:0:25929:0:(obd_config.c:1460:class_process_config()) marker 80 (0x2) lustre-clilov add lustre.test_23c.lustre-OST0000_UUID 00000040:00080000:1.0:1717018971.555851:0:25929:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 125 count 123 00000020:01000000:0.0:1717018971.555988:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 122-124 (rc=0) 10000000:01000000:0.0:1717018971.556004:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018971.556009:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36849 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1d47 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.556018:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a893bcc0/0xe1aedd3f13a36849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1d47 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018971.556047:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018971.556049:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:0.0:1717018971.556051:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018971.556074:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8938000/0xe1aedd3f13a36850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.556079:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8938000/0xe1aedd3f13a36850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.556191:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8938000/0xe1aedd3f13a36850 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018971.556206:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679360:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018971.556526:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018971.558203:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679360:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018971.558234:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8938000/0xe1aedd3f13a36850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1d4e expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.558243:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8938000/0xe1aedd3f13a36850 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1d4e expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018971.558300:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679424:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018971.558343:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018971.560505:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838679424:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018971.560531:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018971.560535:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8938000/0xe1aedd3f13a36850 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1d4e expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018971.560549:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8938000/0xe1aedd3f13a36850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1d4e expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018971.901274:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:2.0:1717018972.796415:0:25951:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:2.0:1717018972.796431:0:25951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1717018972.796442:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.796452:0:25951:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1717018972.796461:0:25951:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:2.0:1717018972.796463:0:25951:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:2.0:1717018972.796467:0:25951:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff88012bda3af8 00010000:00010000:2.0:1717018972.796469:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.796475:0:25951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717018972.796487:0:25951:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:2.0:1717018972.796493:0:25951:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=16 00000080:00200000:2.0:1717018972.796496:0:25951:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d23c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=0 00000002:00010000:2.0:1717018972.796501:0:25951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d23c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1717018972.796530:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.796535:0:25951:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.796543:0:25951:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018972.796568:0:25951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679488:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717018972.796650:0:25951:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880180 going to sleep for 80 seconds 00000100:00100000:2.0:1717018972.798665:0:25951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679488:192.168.203.126@tcp:101:lfs.0 00010000:00010000:2.0:1717018972.798680:0:25951:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798691:0:25951:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798696:0:25951:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798704:0:25951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798710:0:25951:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798717:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798722:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798726:0:25951:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717018972.798744:0:25951:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a89776c0 x1800422838679488/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1717018972.798752:0:25951:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798758:0:25951:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589935617/11510 (0 0) 00000080:00200000:2.0:1717018972.798773:0:25951:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cf6:0x0], updating i_size 11776 00000080:00200000:2.0:1717018972.798776:0:25951:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x2cf6:0x0](ffff880136ed7518): rc = 0 00000080:00010000:2.0:1717018972.798780:0:25951:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cf6:0x0](ffff880136ed7518) for lock 0xe1aedd3f13a36857 00000080:00010000:2.0:1717018972.798788:0:25951:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x2cf6:0x0](ffff880136ed7518) 00000080:00010000:2.0:1717018972.798789:0:25951:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36857 from it ffff88012bda3a70 00010000:00010000:2.0:1717018972.798791:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798796:0:25951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717018972.798815:0:25951:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf6:0x0](ffff880136ed7518), inode mode 41ed mask 1 00000080:00200000:2.0:1717018972.798822:0:25951:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x2cf6:0x0](ffff880136ed7518), flags=0 00000080:00200000:2.0:1717018972.798825:0:25951:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x2cf6:0x0](ffff880136ed7518), intent=getattr 00000002:00010000:2.0:1717018972.798832:0:25951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x2cf6:0x0], intent: getattr flags 0 00010000:00010000:2.0:1717018972.798853:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798858:0:25951:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.798871:0:25951:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018972.798883:0:25951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679552:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717018972.798924:0:25951:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880180 going to sleep for 80 seconds 00000100:00100000:2.0:1717018972.800192:0:25951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679552:192.168.203.126@tcp:101:lfs.0 00010000:00010000:2.0:1717018972.800200:0:25951:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800207:0:25951:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800211:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800216:0:25951:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800221:0:25951:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800226:0:25951:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809c240 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:2.0:1717018972.800229:0:25951:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800234:0:25951:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800249:0:25951:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800254:0:25951:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1717018972.800256:0:25951:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800261:0:25951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809c240/0xe1aedd3f13a3685e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717018972.800270:0:25951:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a89776c0 x1800422838679552/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717019053 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:2.0:1717018972.800284:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800290:0:25951:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1717018972.800295:0:25951:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36857 from it ffff88012bda39f0 00010000:00010000:2.0:1717018972.800297:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800302:0:25951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717018972.800353:0:25951:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:2.0:1717018972.800359:0:25951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1717018972.800363:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800373:0:25951:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1717018972.800379:0:25951:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:2.0:1717018972.800380:0:25951:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:2.0:1717018972.800383:0:25951:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff88012bda3bb0 00010000:00010000:2.0:1717018972.800384:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800389:0:25951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717018972.800394:0:25951:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:2.0:1717018972.800399:0:25951:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d23c.sanity-pfl, flags=17 00000080:00200000:2.0:1717018972.800400:0:25951:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf6:0x0](ffff880136ed7518), inode mode 41ed mask 1 00000080:00200000:2.0:1717018972.800406:0:25951:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f23c.sanity-pfl, flags=769 00000080:00200000:2.0:1717018972.800408:0:25951:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf6:0x0](ffff880136ed7518), inode mode 41ed mask 3 00000080:00200000:2.0:1717018972.800410:0:25951:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x2cf6:0x0](ffff880136ed7518), file ffff88012e171680, open_flags a141, mode 81b6 opened 0 00000080:00200000:2.0:1717018972.800415:0:25951:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x2cf6:0x0](ffff880136ed7518), intent=open|creat 00000002:00010000:2.0:1717018972.800424:0:25951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f23c.sanity-pfl,[0x200000401:0x2cf7:0x0]) in obj [0x200000401:0x2cf6:0x0], intent: open|creat flags 0120502 00010000:00010000:2.0:1717018972.800430:0:25951:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800455:0:25951:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800459:0:25951:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018972.800463:0:25951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809fa80/0xe1aedd3f13a36857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1dcc expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800480:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cf6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.800485:0:25951:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1717018972.800493:0:25951:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1717018972.800496:0:25951:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a89776c0 x1800422838679680/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1717018972.800502:0:25951:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018972.800513:0:25951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679680:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717018972.800611:0:25951:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880180 going to sleep for 80 seconds 00000100:00100000:2.0:1717018972.803015:0:25951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679680:192.168.203.126@tcp:101:lfs.0 00010000:00010000:2.0:1717018972.803042:0:25951:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803059:0:25951:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803064:0:25951:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803070:0:25951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803087:0:25951:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803096:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803100:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803105:0:25951:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000002:00100000:2.0:1717018972.803112:0:25951:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a89776c0 x1800422838679680/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019053 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:2.0:1717018972.803121:0:25951:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a89776c0 x1800422838679680/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019053 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:2.0:1717018972.803127:0:25951:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803133:0:25951:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 16 res 8589935617/11511 (0 0) 00000080:00200000:2.0:1717018972.803146:0:25951:0:(namei.c:1405:ll_create_it()) VFS Op:name=f23c.sanity-pfl, dir=[0x200000401:0x2cf6:0x0](ffff880136ed7518), intent=open|creat 00000080:00200000:2.0:1717018972.803201:0:25951:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cf7:0x0](ffff8800b0af8898) 00000080:00200000:2.0:1717018972.803205:0:25951:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cf7:0x0], updating i_size 0 00000080:00200000:2.0:1717018972.803230:0:25951:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x2cf7:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:2.0:1717018972.803233:0:25951:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x2cf7:0x0](ffff8800b0af8898) 00000080:00010000:2.0:1717018972.803235:0:25951:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cf7:0x0](ffff8800b0af8898) for lock 0xe1aedd3f13a36865 00000080:00200000:2.0:1717018972.803244:0:25951:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x2cf7:0x0](ffff8800b0af8898), flags 120501 00000002:00100000:2.0:1717018972.803255:0:25951:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a89776c0 x1800422838679680/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019053 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:2.0:1717018972.803299:0:25951:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a36865 from it ffff88012b4cef60 00010000:00010000:2.0:1717018972.803301:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803307:0:25951:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1717018972.803318:0:25951:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf7:0x0](ffff8800b0af8898), inode mode 81a4 mask 40 00000080:00200000:2.0:1717018972.803374:0:25951:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cf7:0x0](ffff8800b0af8898), inode mode 81a4 mask 2 00000080:00200000:2.0:1717018972.803380:0:25951:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x2cf7:0x0](ffff8800b0af8898), xattr lov 00000002:00010000:2.0:1717018972.803388:0:25951:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x2cf7:0x0]) in obj [0x200000401:0x2cf6:0x0], intent: open flags 040000002 00010000:00010000:2.0:1717018972.803412:0:25951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018972.803415:0:25951:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000020:00100000:2.0:1717018972.803421:0:25951:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1717018972.803424:0:25951:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a8972ac0 x1800422838679808/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:2.0:1717018972.803427:0:25951:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018972.803436:0:25951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679808:192.168.203.126@tcp:101:lfs.0 00000100:00100000:2.0:1717018972.803480:0:25951:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880180 going to sleep for 80 seconds 00000100:00100000:3.0:1717018972.805118:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018972.805214:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819923776 00000100:00100000:2.0:1717018972.805260:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77877 00000100:00100000:2.0:1717018972.805265:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a24c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:12cff408-c572-49fa-81b0-09052c8e7f41+5:8251:x1800422819923776:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018972.805307:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018972.805311:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a24c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:12cff408-c572-49fa-81b0-09052c8e7f41+5:8251:x1800422819923776:12345-192.168.203.126@tcp:104: Request processed in 47us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018972.805315:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77877 00010000:00010000:0.0:1717018972.805451:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018972.805456:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018972.805464:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d200 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018972.805467:0:10237:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018972.805472:0:10237:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018972.805478:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018972.805496:0:10237:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x2cf7:0x0]: losing layout lock 00010000:00010000:0.0:1717018972.805520:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018972.805525:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018972.805551:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018972.805556:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809d200/0xe1aedd3f13a36865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf7:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1dfd expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018972.805598:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838679872:192.168.203.126@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1717018972.805600:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018972.805605:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018972.805607:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018972.808182:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838679872:192.168.203.126@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018972.902785:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018973.424772:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680000:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018973.424830:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680128:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018973.424849:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018973.424853:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838679936:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018973.424865:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680064:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018973.426864:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838679936:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018973.426877:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680064:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018973.426884:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680000:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018973.426890:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680128:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:1.0:1717018973.905894:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018974.906945:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018975.909253:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018976.910799:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018977.912934:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018978.433384:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680256:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018978.433522:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680384:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018978.433546:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018978.433550:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838680192:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018978.433563:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680320:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018978.435818:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680320:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018978.435831:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680256:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018978.435839:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680384:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018978.435855:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838680192:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1717018978.915034:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018979.917573:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018980.918936:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018981.921432:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018982.922910:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018983.440993:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680512:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018983.441056:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680640:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018983.441077:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018983.441081:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838680448:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018983.441095:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680576:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018983.444377:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680512:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018983.444390:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680640:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018983.445693:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838680448:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018983.445706:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680576:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:1.0:1717018983.925032:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018984.927320:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018985.929616:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018986.930858:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018987.932968:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018988.448789:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680768:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018988.448854:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680896:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018988.448871:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838680704:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018988.448896:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838680832:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018988.451991:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838680832:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018988.452520:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680768:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018988.452532:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838680896:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018988.453274:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838680704:192.168.203.126@tcp:400:kworker/u8:4.0 00010000:00010000:1.0:1717018988.935029:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018989.936742:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018990.938758:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018991.941032:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018992.808329:0:25951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838679808:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717018992.808346:0:25951:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808356:0:25951:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808362:0:25951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808366:0:25951:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808371:0:25951:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808377:0:25951:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809df80 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018992.808379:0:25951:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808384:0:25951:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808389:0:25951:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808394:0:25951:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717018992.808396:0:25951:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018992.808407:0:25951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a809df80/0xe1aedd3f13a3686c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf6:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 25951 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018992.808488:0:25951:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a8972ac0 x1800422838679808/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/600 e 0 to 0 dl 1717019053 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1717018992.808501:0:25951:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1717018992.808570:0:25951:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x2cf7:0x0](ffff8800b0af8898) 00000002:00100000:0.0:1717018992.809057:0:25951:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a89776c0 x1800422838679680/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019053 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1717018992.809075:0:25951:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1717018992.809078:0:25951:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa63dc0 x1800422838681024/t0(0) o35->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1717018992.809093:0:25951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838681024:192.168.203.126@tcp:35:lfs.0 00000100:00100000:0.0:1717018992.809150:0:25951:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0d80 going to sleep for 6 seconds 00000100:00100000:0.0:1717018992.811833:0:25951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa63dc0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:25951:1800422838681024:192.168.203.126@tcp:35:lfs.0 00000002:00100000:0.0:1717018992.811855:0:25951:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a89776c0 x1800422838679680/t12884902041(12884902041) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717019053 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:2.0:1717018992.942698:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1717018993.244476:0:26099:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717018993.244479:0:26099:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_23c: @@@@@@ FAIL: Create /mnt/lustre/d23c.sanity-pfl/f23c.sanity-pfl failed 00000100:00100000:3.0:1717018993.458455:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a22f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838681088:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018993.458514:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a250c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838681216:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018993.458533:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1717018993.458537:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a204c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838681152:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018993.458550:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a24740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838681280:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018993.462539:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a22f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838681088:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018993.463290:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a204c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838681152:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018993.463300:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a24740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838681280:192.168.203.126@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018993.463308:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a250c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838681216:192.168.203.126@tcp:400:kworker/u8:4.0 Debug log: 587 lines, 587 kept, 0 dropped, 0 bad.