00010000:00010000:2.0F:1717018836.610815:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018837.613717:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018838.210769:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663360:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018838.210837:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663488:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018838.210861:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018838.210865:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838663296:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018838.210881:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663424:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0F:1717018838.214449:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838663296:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018838.214475:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89776c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663424:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018838.214485:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663488:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018838.214920:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89717c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663360:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018838.616885:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1717018839.620088:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1717018839.739832:0:21912:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717018839.739836:0:21912:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22c: Test repeat with out of space on > 1 OST ========================================================== 17:40:39 (1717018839) 00000080:00200000:0.0F:1717018839.837519:0:21775:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717018839.837540:0:21775:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1717018839.837553:0:21775:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.837563:0:21775:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1717018839.837571:0:21775:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717018839.837574:0:21775:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:0.0:1717018839.837579:0:21775:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a9e6baf8 00010000:00010000:0.0:1717018839.837600:0:21775:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.837605:0:21775:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018839.837617:0:21775:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:0.0:1717018839.837624:0:21775:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1 00000080:00200000:0.0:1717018839.837627:0:21775:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=getattr 00000002:00010000:0.0:1717018839.837634:0:21775:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1717018839.837667:0:21775:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.837673:0:21775:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.837680:0:21775:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018839.837699:0:21775:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:21775:1800422838663552:192.168.203.126@tcp:101:bash.0 00000100:00100000:0.0:1717018839.837778:0:21775:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0cc0 going to sleep for 87 seconds 00000100:00100000:0.0:1717018839.841323:0:21775:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:21775:1800422838663552:192.168.203.126@tcp:101:bash.0 00010000:00010000:0.0:1717018839.841339:0:21775:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841351:0:21775:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841356:0:21775:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841362:0:21775:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841367:0:21775:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841373:0:21775:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a893a1c0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018839.841376:0:21775:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841380:0:21775:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841385:0:21775:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841390:0:21775:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717018839.841393:0:21775:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841404:0:21775:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893a1c0/0xe1aedd3f13a36715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018839.841416:0:21775:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012fa676c0 x1800422838663552/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018928 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1717018839.841440:0:21775:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1717018839.841563:0:21775:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717018839.841572:0:21775:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1717018839.841576:0:21775:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1717018839.841629:0:21775:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841634:0:21775:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.841640:0:21775:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018839.841653:0:21775:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:21775:1800422838663616:192.168.203.126@tcp:101:bash.0 00000100:00100000:0.0:1717018839.841708:0:21775:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0cc0 going to sleep for 87 seconds 00000100:00100000:0.0:1717018839.843243:0:21775:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:21775:1800422838663616:192.168.203.126@tcp:101:bash.0 00010000:00010000:0.0:1717018839.843257:0:21775:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843264:0:21775:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843280:0:21775:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843286:0:21775:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843292:0:21775:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843297:0:21775:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843301:0:21775:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018839.843308:0:21775:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012fa676c0 x1800422838663616/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1717018928 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:0.0:1717018839.843316:0:21775:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843322:0:21775:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:0.0:1717018839.843341:0:21775:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:0.0:1717018839.843346:0:21775:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a3671c 00000080:00010000:0.0:1717018839.843350:0:21775:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:0.0:1717018839.843352:0:21775:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a3671c from it ffff8800a9e6bcf8 00010000:00010000:0.0:1717018839.843354:0:21775:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018839.843366:0:21775:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018839.846139:0:21936:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018839.846155:0:21936:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018839.846167:0:21936:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846177:0:21936:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018839.846184:0:21936:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018839.846187:0:21936:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018839.846191:0:21936:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8377b58 00010000:00010000:3.0:1717018839.846193:0:21936:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846197:0:21936:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018839.846207:0:21936:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:3.0:1717018839.846215:0:21936:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1536 00000080:00200000:3.0:1717018839.846217:0:21936:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018839.846220:0:21936:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018839.846223:0:21936:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846234:0:21936:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018839.846240:0:21936:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018839.846241:0:21936:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018839.846243:0:21936:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8377bf8 00010000:00010000:3.0:1717018839.846245:0:21936:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846248:0:21936:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018839.846254:0:21936:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:3.0:1717018839.846257:0:21936:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018839.846259:0:21936:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018839.846262:0:21936:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846266:0:21936:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018839.846270:0:21936:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018839.846271:0:21936:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018839.846273:0:21936:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8377da0 00010000:00010000:3.0:1717018839.846274:0:21936:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846278:0:21936:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018839.846288:0:21936:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:3.0:1717018839.846292:0:21936:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d22c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8) 00800000:00000004:3.0:1717018839.846302:0:21936:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800b604b800: age 1548, max_age 0 00000100:00100000:3.0:1717018839.846355:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1717018839.846371:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a26880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663680:192.168.203.126@tcp:41:mkdir.0 00010000:00010000:3.0:1717018839.846447:0:21936:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846458:0:21936:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846483:0:21936:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018839.846488:0:21936:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018839.846489:0:21936:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893aac0/0xe1aedd3f13a3671c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c1640 expref: -99 pid: 21775 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1717018839.846500:0:21936:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1717018839.846504:0:21936:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880136a20e40 x1800422838663808/t0(0) o36->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1717018839.846515:0:21936:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a20e40 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:21936:1800422838663808:192.168.203.126@tcp:36:mkdir.0 00000100:00100000:3.0:1717018839.846531:0:21936:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd780 going to sleep for 87 seconds 00000100:00100000:3.0:1717018839.849877:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a26880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838663680:192.168.203.126@tcp:41:mkdir.0 00000100:00100000:0.0:1717018839.852098:0:21936:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a20e40 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:21936:1800422838663808:192.168.203.126@tcp:36:mkdir.0 00000080:00200000:0.0:1717018839.852129:0:21936:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cee:0x0](ffff8800b0a34698) 00000080:00200000:0.0:1717018839.852133:0:21936:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cee:0x0], updating i_size 512 00000100:00100000:3.0:1717018840.228246:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018840.228298:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018840.228335:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819880768 00000100:00100000:2.0:1717018840.228399:0:10294:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819880832 00000100:00100000:3.0:1717018840.228508:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77855 00000100:00100000:3.0:1717018840.228514:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a26880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+4:26012:x1800422819880768:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018840.228610:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018840.228616:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a26880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:461e9689-0dac-4669-87c3-00abdddc539f+4:26012:x1800422819880768:12345-192.168.203.126@tcp:104: Request processed in 103us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018840.228622:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77855 00010000:00010000:0.0:1717018840.228825:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018840.228830:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a85cbcc0/0xe1aedd3f13a3663c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c131b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018840.228838:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85cbcc0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018840.228841:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a85cbcc0/0xe1aedd3f13a3663c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c131b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018840.228846:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a85cbcc0/0xe1aedd3f13a3663c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c131b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018840.228851:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a85cbcc0/0xe1aedd3f13a3663c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c131b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018840.228854:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1717018840.228946:0:10294:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77856 00000100:00100000:2.0:1717018840.228950:0:10294:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a217c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:26012:x1800422819880832:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018840.228973:0:10294:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018840.228976:0:10294:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a217c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_002:461e9689-0dac-4669-87c3-00abdddc539f+4:26012:x1800422819880832:12345-192.168.203.126@tcp:104: Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018840.228981:0:10294:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77856 00010000:00010000:2.0:1717018840.229072:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717018840.229074:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a36635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1314 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018840.229079:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d680 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:2.0:1717018840.229081:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a36635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1314 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018840.229085:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a36635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1314 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018840.229088:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a36635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1314 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018840.229097:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018840.229134:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a85cbcc0/0xe1aedd3f13a3663c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c131b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018840.229138:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018840.229814:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a85cbcc0/0xe1aedd3f13a3663c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c131b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018840.229821:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a85cbcc0/0xe1aedd3f13a3663c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c131b expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018840.229846:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018840.229847:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018840.229848:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018840.229853:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1717018840.229865:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838663872:192.168.203.126@tcp:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018840.230094:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a36635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1314 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018840.230101:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018840.230116:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a36635 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1314 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018840.230120:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a36635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1314 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018840.230131:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018840.230132:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018840.230133:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018840.230137:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1717018840.230143:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838663936:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1717018840.232303:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838663872:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018840.232421:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838663936:192.168.203.126@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018840.620770:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018841.622731:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1717018842.038679:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1717018842.038686:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 88 10000000:01000000:1.0:1717018842.038691:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1717018842.038724:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018842.038732:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018842.038740:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018842.038759:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664000:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018842.038837:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018842.042155:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664000:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018842.042178:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018842.042188:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018842.042246:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664064:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018842.042424:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018842.045109:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664064:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018842.045156:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664128:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018842.045871:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018842.051967:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664128:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018842.053444:0:21948:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:21948:1800422838664192:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018842.053528:0:21948:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018842.057635:0:21948:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:21948:1800422838664192:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018842.057674:0:21948:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018842.057755:0:21948:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018842.057757:0:21948:0:(obd_config.c:1460:class_process_config()) marker 58 (0x1) lustre-clilov new lustre.test_22c 00000020:01000000:1.0:1717018842.057762:0:21948:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:1.0:1717018842.057764:0:21948:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1717018842.057778:0:21948:0:(lov_pool.c:313:lov_pool_new()) test_22c is pool #2 00000100:00100000:1.0:1717018842.057809:0:21948:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:21948:1800422838664256:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018842.057984:0:21948:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892fd80 going to sleep for 6 seconds 00000100:00100000:1.0:1717018842.061066:0:21948:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:21948:1800422838664256:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018842.061123:0:21948:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:21948:1800422838664320:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018842.061191:0:21948:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892fd80 going to sleep for 6 seconds 00000100:00100000:1.0:1717018842.067009:0:21948:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:21948:1800422838664320:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:1.0:1717018842.067047:0:21948:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1717018842.067053:0:21948:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018842.067055:0:21948:0:(obd_config.c:1460:class_process_config()) marker 58 (0x2) lustre-clilov new lustre.test_22c 00000040:00080000:1.0:1717018842.067058:0:21948:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 92 count 90 00000020:01000000:2.0:1717018842.067322:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 88-91 (rc=0) 10000000:01000000:2.0:1717018842.067338:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018842.067344:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018842.067352:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018842.067359:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018842.067361:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717018842.067370:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018842.067391:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018842.067397:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018842.067403:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018842.067417:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664384:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018842.067778:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018842.071163:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664384:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018842.071188:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.071197:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018842.071250:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664448:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018842.071295:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0300 going to sleep for 6 seconds 00000100:00100000:0.0:1717018842.075548:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664448:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1717018842.075609:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1717018842.075615:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.075624:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018842.624996:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018842.983969:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018842.984050:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819883968 00000100:00100000:2.0:1717018842.984092:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77857 00000100:00100000:2.0:1717018842.984098:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a23440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:26220:x1800422819883968:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018842.984184:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018842.984189:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a23440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:26220:x1800422819883968:12345-192.168.203.126@tcp:104: Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018842.984195:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77857 00010000:00010000:0.0:1717018842.984260:0:10309:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018842.984265:0:10309:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.984284:0:10309:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a809d680 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018842.984287:0:10309:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.984294:0:10309:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018842.984299:0:10309:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018842.984303:0:10309:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018842.984345:0:10309:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.984351:0:10309:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018842.984375:0:10309:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.984380:0:10309:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a809d680/0xe1aedd3f13a3672a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16a9 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.984405:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018842.984406:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018842.984407:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018842.984412:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838664512:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018842.985349:0:1827:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:2.0:1717018842.985410:0:4621:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819884416 00000100:00100000:2.0:1717018842.985428:0:4621:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77858 00000100:00100000:2.0:1717018842.985432:0:4621:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a23dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:26220:x1800422819884416:12345-192.168.203.126@tcp:104: 00010000:00010000:2.0:1717018842.985467:0:4621:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717018842.985471:0:4621:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a23dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:461e9689-0dac-4669-87c3-00abdddc539f+3:26220:x1800422819884416:12345-192.168.203.126@tcp:104: Request processed in 38us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018842.985477:0:4621:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77858 00010000:00010000:0.0:1717018842.985618:0:10237:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018842.985622:0:10237:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.985628:0:10237:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f233c0 already unused, calling callback (ffffffffa0ac95c0) 10000000:00010000:0.0:1717018842.985630:0:10237:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.985643:0:10237:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018842.985647:0:10237:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018842.985650:0:10237:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018842.985668:0:10237:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.985672:0:10237:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018842.985689:0:10237:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.985693:0:10237:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a8f233c0/0xe1aedd3f13a36723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1678 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018842.985704:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018842.985705:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018842.985707:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018842.985714:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838664576:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1717018842.986074:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838664512:192.168.203.126@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1717018842.987332:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838664576:192.168.203.126@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1717018843.217080:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838664640:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018843.217545:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838664704:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018843.217613:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1717018843.217619:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838664768:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018843.219576:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838664640:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018843.219637:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838664768:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018843.219647:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838664704:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018843.626795:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717018844.147165:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018844.147170:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800b604b800 from 92 10000000:01000000:2.0:1717018844.147174:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018844.147203:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.147211:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.147218:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018844.147238:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664832:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018844.147310:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018844.149462:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664832:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018844.149484:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.149493:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018844.149551:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664896:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018844.149619:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018844.151845:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664896:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018844.151905:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664960:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018844.151970:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018844.154328:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838664960:192.168.203.126@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018844.154678:0:22006:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a24740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22006:1800422838665024:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717018844.154728:0:22006:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffd240 going to sleep for 6 seconds 00000100:00100000:0.0:1717018844.156299:0:22006:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a24740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22006:1800422838665024:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717018844.156325:0:22006:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1717018844.156332:0:22006:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018844.156333:0:22006:0:(obd_config.c:1460:class_process_config()) marker 60 (0x1) lustre-clilov add lustre.test_22c.lustre-OST0000_UUID 00000020:01000000:0.0:1717018844.156338:0:22006:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:0.0:1717018844.156340:0:22006:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1717018844.156348:0:22006:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0000_UUID to test_22c as member 1 00000020:01000000:0.0:1717018844.156357:0:22006:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1717018844.156364:0:22006:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018844.156365:0:22006:0:(obd_config.c:1460:class_process_config()) marker 60 (0x2) lustre-clilov add lustre.test_22c.lustre-OST0000_UUID 00000020:01000000:0.0:1717018844.156367:0:22006:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1717018844.156369:0:22006:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018844.156370:0:22006:0:(obd_config.c:1460:class_process_config()) marker 62 (0x1) lustre-clilov add lustre.test_22c.lustre-OST0001_UUID 00000020:01000000:0.0:1717018844.156372:0:22006:0:(obd_config.c:1904:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b604b800 00000020:00000080:0.0:1717018844.156373:0:22006:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1717018844.156376:0:22006:0:(lov_pool.c:425:lov_pool_add()) Added lustre-OST0001_UUID to test_22c as member 2 00000100:00100000:0.0:1717018844.156394:0:22006:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22006:1800422838665088:192.168.203.126@tcp:502:llog_process_th.0 00000100:00100000:0.0:1717018844.156445:0:22006:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0180 going to sleep for 6 seconds 00000100:00100000:0.0:1717018844.157963:0:22006:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:461e9689-0dac-4669-87c3-00abdddc539f:22006:1800422838665088:192.168.203.126@tcp:502:llog_process_th.0 00000020:01000000:0.0:1717018844.157988:0:22006:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1717018844.157991:0:22006:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018844.157992:0:22006:0:(obd_config.c:1460:class_process_config()) marker 62 (0x2) lustre-clilov add lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:0.0:1717018844.157995:0:22006:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 98 count 96 00000020:01000000:2.0:1717018844.158154:0:4633:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 92-97 (rc=0) 10000000:01000000:2.0:1717018844.158172:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018844.158177:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.158185:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809df80/0xe1aedd3f13a36731 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c173c expref: -99 pid: 4633 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018844.158193:0:4633:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018844.158195:0:4633:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800b0140000 from 1 10000000:01000000:2.0:1717018844.158197:0:4633:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018844.158215:0:4633:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.158220:0:4633:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.158226:0:4633:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018844.158242:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838665152:192.168.203.126@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018844.158468:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018844.159755:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838665152:192.168.203.126@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018844.159781:0:4633:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.159835:0:4633:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018844.159905:0:4633:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838665216:192.168.203.126@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018844.159973:0:4633:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a8880840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018844.161279:0:4633:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:461e9689-0dac-4669-87c3-00abdddc539f:4633:1800422838665216:192.168.203.126@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1717018844.161313:0:4633:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1717018844.161319:0:4633:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.161328:0:4633:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a809dd40/0xe1aedd3f13a36738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1743 expref: -99 pid: 4633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018844.628773:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018845.630981:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018846.632817:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018847.634763:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018848.224778:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665344:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018848.224842:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665472:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018848.224860:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018848.224864:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838665280:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018848.224876:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665408:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018848.226913:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838665280:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018848.226927:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665408:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018848.226935:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665344:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018848.226942:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665472:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018848.637345:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018849.638915:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018850.643061:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018851.644693:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018852.646808:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018853.233112:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665600:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018853.233190:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665728:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018853.233213:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1717018853.233217:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838665536:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018853.233231:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665664:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018853.236335:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838665536:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018853.236353:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665664:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018853.236364:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665600:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018853.236373:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8977200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838665728:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018853.650075:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1717018853.975914:0:22192:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018853.975936:0:22192:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018853.975951:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.975963:0:22192:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018853.975973:0:22192:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018853.975975:0:22192:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018853.975982:0:22192:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a905baf8 00010000:00010000:1.0:1717018853.975984:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.975990:0:22192:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018853.976005:0:22192:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018853.976016:0:22192:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=16 00000080:00200000:1.0:1717018853.976019:0:22192:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22c.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=0 00000002:00010000:1.0:1717018853.976028:0:22192:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018853.976067:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.976079:0:22192:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.976088:0:22192:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018853.976111:0:22192:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838665792:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018853.976759:0:22192:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 87 seconds 00000100:00100000:1.0:1717018853.979248:0:22192:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838665792:192.168.203.126@tcp:101:lfs.0 00010000:00010000:1.0:1717018853.979270:0:22192:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979287:0:22192:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979292:0:22192:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979300:0:22192:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979309:0:22192:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979317:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979323:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979337:0:22192:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018853.979347:0:22192:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a93e63c0 x1800422838665792/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018942 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1717018853.979357:0:22192:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979365:0:22192:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589935617/11502 (0 0) 00000080:00200000:1.0:1717018853.979387:0:22192:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cee:0x0], updating i_size 11776 00000080:00200000:1.0:1717018853.979389:0:22192:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x2cee:0x0](ffff8800b0a34698): rc = 0 00000080:00010000:1.0:1717018853.979396:0:22192:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cee:0x0](ffff8800b0a34698) for lock 0xe1aedd3f13a3673f 00000080:00010000:1.0:1717018853.979407:0:22192:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x2cee:0x0](ffff8800b0a34698) 00000080:00010000:1.0:1717018853.979410:0:22192:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a3673f from it ffff8800a905ba70 00010000:00010000:1.0:1717018853.979411:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979417:0:22192:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018853.979444:0:22192:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cee:0x0](ffff8800b0a34698), inode mode 41ed mask 1 00000080:00200000:1.0:1717018853.979456:0:22192:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f22c.sanity-pfl, dir=[0x200000401:0x2cee:0x0](ffff8800b0a34698), flags=0 00000080:00200000:1.0:1717018853.979459:0:22192:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22c.sanity-pfl, dir=[0x200000401:0x2cee:0x0](ffff8800b0a34698), intent=getattr 00000002:00010000:1.0:1717018853.979471:0:22192:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22c.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x2cee:0x0], intent: getattr flags 0 00010000:00010000:1.0:1717018853.979502:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979515:0:22192:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.979522:0:22192:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018853.979539:0:22192:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838665856:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018853.979620:0:22192:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 87 seconds 00000100:00100000:1.0:1717018853.981963:0:22192:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838665856:192.168.203.126@tcp:101:lfs.0 00010000:00010000:1.0:1717018853.981984:0:22192:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.981997:0:22192:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982002:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982007:0:22192:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982013:0:22192:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982018:0:22192:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f20fc0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:1.0:1717018853.982021:0:22192:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982039:0:22192:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982044:0:22192:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982050:0:22192:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1717018853.982053:0:22192:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982058:0:22192:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f20fc0/0xe1aedd3f13a36746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018853.982071:0:22192:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a93e63c0 x1800422838665856/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018942 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:1.0:1717018853.982101:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982114:0:22192:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 2/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018853.982121:0:22192:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a3673f from it ffff8800a905b9f0 00010000:00010000:1.0:1717018853.982123:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982128:0:22192:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018853.982300:0:22192:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018853.982314:0:22192:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018853.982321:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982327:0:22192:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018853.982333:0:22192:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018853.982335:0:22192:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018853.982340:0:22192:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a905bbb0 00010000:00010000:1.0:1717018853.982341:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982346:0:22192:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018853.982352:0:22192:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018853.982359:0:22192:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d22c.sanity-pfl, flags=17 00000080:00200000:1.0:1717018853.982361:0:22192:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cee:0x0](ffff8800b0a34698), inode mode 41ed mask 1 00000080:00200000:1.0:1717018853.982368:0:22192:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=f22c.sanity-pfl, flags=769 00000080:00200000:1.0:1717018853.982370:0:22192:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cee:0x0](ffff8800b0a34698), inode mode 41ed mask 3 00000080:00200000:1.0:1717018853.982374:0:22192:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f22c.sanity-pfl, dir=[0x200000401:0x2cee:0x0](ffff8800b0a34698), file ffff88012e19cf00, open_flags a141, mode 81b6 opened 0 00000080:00200000:1.0:1717018853.982382:0:22192:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22c.sanity-pfl, dir=[0x200000401:0x2cee:0x0](ffff8800b0a34698), intent=open|creat 00000002:00010000:1.0:1717018853.982393:0:22192:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22c.sanity-pfl,[0x200000401:0x2cef:0x0]) in obj [0x200000401:0x2cee:0x0], intent: open|creat flags 0120502 00010000:00010000:1.0:1717018853.982402:0:22192:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982439:0:22192:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982448:0:22192:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018853.982449:0:22192:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a3673f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2cee:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c175f expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982473:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.982478:0:22192:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1717018853.982486:0:22192:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1717018853.982491:0:22192:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a93e63c0 x1800422838665984/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1717018853.982496:0:22192:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018853.982511:0:22192:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838665984:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018853.982660:0:22192:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 87 seconds 00000100:00100000:1.0:1717018853.985130:0:22192:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e63c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838665984:192.168.203.126@tcp:101:lfs.0 00010000:00010000:1.0:1717018853.985155:0:22192:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985176:0:22192:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985180:0:22192:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985201:0:22192:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985215:0:22192:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985224:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985230:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985234:0:22192:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018853.985242:0:22192:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff8800a93e63c0 x1800422838665984/t12884902029(12884902029) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018942 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:1.0:1717018853.985252:0:22192:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a93e63c0 x1800422838665984/t12884902029(12884902029) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018942 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:1.0:1717018853.985260:0:22192:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985267:0:22192:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 16 res 8589935617/11503 (0 0) 00000080:00200000:1.0:1717018853.985286:0:22192:0:(namei.c:1405:ll_create_it()) VFS Op:name=f22c.sanity-pfl, dir=[0x200000401:0x2cee:0x0](ffff8800b0a34698), intent=open|creat 00000080:00200000:1.0:1717018853.985617:0:22192:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cef:0x0](ffff880136ed4e58) 00000080:00200000:1.0:1717018853.985622:0:22192:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cef:0x0], updating i_size 0 00000080:00200000:1.0:1717018853.985651:0:22192:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x2cef:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:1.0:1717018853.985661:0:22192:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x2cef:0x0](ffff880136ed4e58) 00000080:00010000:1.0:1717018853.985664:0:22192:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cef:0x0](ffff880136ed4e58) for lock 0xe1aedd3f13a3674d 00000080:00200000:1.0:1717018853.985678:0:22192:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x2cef:0x0](ffff880136ed4e58), flags 120501 00000002:00100000:1.0:1717018853.985691:0:22192:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800a93e63c0 x1800422838665984/t12884902029(12884902029) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018942 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:1.0:1717018853.985782:0:22192:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a3674d from it ffff8800b00bc180 00010000:00010000:1.0:1717018853.985785:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985792:0:22192:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018853.985807:0:22192:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cef:0x0](ffff880136ed4e58), inode mode 81a4 mask 40 00000080:00200000:1.0:1717018853.985909:0:22192:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cef:0x0](ffff880136ed4e58), inode mode 81a4 mask 2 00000080:00200000:1.0:1717018853.985918:0:22192:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x2cef:0x0](ffff880136ed4e58), xattr lov 00000002:00010000:1.0:1717018853.985930:0:22192:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x2cef:0x0]) in obj [0x200000401:0x2cee:0x0], intent: open flags 040000002 00010000:00010000:1.0:1717018853.985972:0:22192:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018853.985977:0:22192:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1717018853.985987:0:22192:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1717018853.985991:0:22192:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a93e50c0 x1800422838666112/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:1.0:1717018853.985997:0:22192:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018853.986013:0:22192:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e50c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838666112:192.168.203.126@tcp:101:lfs.0 00000100:00100000:1.0:1717018853.986091:0:22192:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 87 seconds 00000100:00100000:2.0:1717018853.988013:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018853.988109:0:18297:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819887616 00000100:00100000:3.0:1717018853.988238:0:18297:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77859 00000100:00100000:3.0:1717018853.988244:0:18297:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8977200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:12cff408-c572-49fa-81b0-09052c8e7f41+5:8253:x1800422819887616:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018853.988302:0:18297:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018853.988307:0:18297:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8977200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_003:12cff408-c572-49fa-81b0-09052c8e7f41+5:8253:x1800422819887616:12345-192.168.203.126@tcp:104: Request processed in 63us (728us total) trans 0 rc 0/0 00010000:00010000:0.0:1717018853.988309:0:4630:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1717018853.988312:0:18297:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77859 00010000:00010000:0.0:1717018853.988313:0:4630:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018853.988322:0:4630:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f21b00 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018853.988325:0:4630:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018853.988330:0:4630:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018853.988335:0:4630:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018853.988366:0:4630:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x2cef:0x0]: losing layout lock 00010000:00010000:0.0:1717018853.988396:0:4630:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018853.988401:0:4630:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018853.988423:0:4630:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018853.988428:0:4630:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f21b00/0xe1aedd3f13a3674d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cef:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1790 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018853.988443:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018853.988444:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018853.988445:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018853.988457:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1717018853.988470:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838666176:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1717018853.990010:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa676c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838666176:192.168.203.126@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1717018854.652785:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018855.655288:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018856.656925:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018857.658753:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018858.241324:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666304:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018858.241366:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838666240:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018858.241842:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838666368:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018858.241883:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666432:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018858.246104:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838666240:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018858.248505:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666304:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018858.248518:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666432:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018858.249641:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e5580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838666368:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018858.661985:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018859.665449:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018860.667155:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018861.670500:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018862.672836:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018863.248819:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666560:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018863.248819:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838666496:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018863.248892:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666688:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018863.248892:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838666624:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018863.252242:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666688:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018863.252268:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666560:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018863.252312:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:461e9689-0dac-4669-87c3-00abdddc539f:1834:1800422838666496:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018863.252320:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:12cff408-c572-49fa-81b0-09052c8e7f41:1834:1800422838666624:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018863.674807:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018864.677520:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018865.679831:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018866.681217:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018867.682956:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018868.256942:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666816:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018868.257024:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666944:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018868.257048:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1717018868.257053:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838666752:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018868.257067:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666880:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018868.262151:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:461e9689-0dac-4669-87c3-00abdddc539f:1833:1800422838666752:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018868.262181:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e04c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666880:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018868.262191:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666816:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018868.262200:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e1c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838666944:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018868.685607:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018869.686821:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018870.689003:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018871.690789:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018872.692848:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018873.265010:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1717018873.265029:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838667008:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018873.265113:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667072:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018873.265141:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1717018873.265144:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667136:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018873.265172:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667200:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018873.267212:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667200:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018873.267224:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667136:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018873.267231:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8972140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838667072:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018873.267238:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838667008:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018873.695417:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018873.991980:0:22192:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e50c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838666112:192.168.203.126@tcp:101:lfs.0 00010000:00010000:1.0:1717018873.991997:0:22192:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992007:0:22192:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992012:0:22192:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992016:0:22192:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992021:0:22192:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992026:0:22192:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f206c0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:1.0:1717018873.992029:0:22192:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992033:0:22192:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992048:0:22192:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992052:0:22192:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1717018873.992055:0:22192:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018873.992059:0:22192:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f206c0/0xe1aedd3f13a36754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cee:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 22192 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018873.992079:0:22192:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff8800a93e50c0 x1800422838666112/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/600 e 0 to 0 dl 1717018942 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:1.0:1717018873.992090:0:22192:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:1.0:1717018873.992177:0:22192:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x2cef:0x0](ffff880136ed4e58) 00000002:00100000:1.0:1717018873.992199:0:22192:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff8800a93e63c0 x1800422838665984/t12884902029(12884902029) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018942 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:1.0:1717018873.992218:0:22192:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:1.0:1717018873.992221:0:22192:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a93e50c0 x1800422838667328/t0(0) o35->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1717018873.992234:0:22192:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e50c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838667328:192.168.203.126@tcp:35:lfs.0 00000100:00100000:1.0:1717018873.992278:0:22192:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a892f780 going to sleep for 6 seconds 00000100:00100000:1.0:1717018873.993910:0:22192:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e50c0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:22192:1800422838667328:192.168.203.126@tcp:35:lfs.0 00000002:00100000:1.0:1717018873.993929:0:22192:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a93e63c0 x1800422838665984/t12884902029(12884902029) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018942 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000400:00000080:3.0:1717018874.417530:0:22339:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1717018874.417533:0:22339:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22c: @@@@@@ FAIL: Create /mnt/lustre/d22c.sanity-pfl/f22c.sanity-pfl failed 00010000:00010000:1.0:1717018874.697287:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 607 lines, 607 kept, 0 dropped, 0 bad.