00010000:00010000:1.0F:1717018766.450840:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1717018767.453303:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018768.096856:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658048:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018768.096924:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658176:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018768.096945:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018768.096950:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838657984:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018768.096963:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658112:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018768.099933:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838657984:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018768.099954:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658112:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018768.099963:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658048:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018768.101106:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658176:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018768.454989:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018769.457046:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018770.458855:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018771.460794:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018772.462813:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018773.104930:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658304:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0F:1717018773.104949:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838658240:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018773.104999:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658432:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018773.105001:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838658368:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018773.108491:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838658240:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018773.110706:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838658368:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018773.110778:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658304:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018773.110795:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658432:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018773.464849:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018774.466928:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018775.471574:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018776.474522:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018777.477163:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018778.113412:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658560:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018778.113487:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658688:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018778.113513:0:1835:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018778.113518:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838658496:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018778.113534:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658624:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018778.117041:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:461e9689-0dac-4669-87c3-00abdddc539f:1835:1800422838658496:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018778.117057:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658624:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018778.117065:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658560:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018778.117072:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838658688:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018778.478911:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018779.480766:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1717018780.043289:0:20195:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717018780.043294:0:20195:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22a: Test repeat component behavior with degraded OST ========================================================== 17:39:39 (1717018779) 00000080:00200000:1.0:1717018780.130448:0:20059:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018780.130467:0:20059:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018780.130481:0:20059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.130494:0:20059:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018780.130504:0:20059:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018780.130506:0:20059:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018780.130513:0:20059:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff88012c7dbaf8 00010000:00010000:1.0:1717018780.130515:0:20059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.130521:0:20059:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018780.130535:0:20059:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018780.130542:0:20059:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1 00000080:00200000:1.0:1717018780.130546:0:20059:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=getattr 00000002:00010000:1.0:1717018780.130553:0:20059:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22a.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1717018780.130605:0:20059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.130611:0:20059:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.130623:0:20059:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018780.130646:0:20059:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:20059:1800422838658752:192.168.203.126@tcp:101:bash.0 00000100:00100000:1.0:1717018780.130709:0:20059:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387a80 going to sleep for 87 seconds 00000100:00100000:0.0F:1717018780.134082:0:20059:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e3900 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:20059:1800422838658752:192.168.203.126@tcp:101:bash.0 00010000:00010000:0.0:1717018780.134105:0:20059:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134118:0:20059:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134123:0:20059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134128:0:20059:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134133:0:20059:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134139:0:20059:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8f233c0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018780.134142:0:20059:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134146:0:20059:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134151:0:20059:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134156:0:20059:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717018780.134159:0:20059:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134164:0:20059:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a8f233c0/0xe1aedd3f13a366c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018780.134183:0:20059:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a93e3900 x1800422838658752/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018869 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:0.0:1717018780.134212:0:20059:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:0.0:1717018780.134335:0:20059:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:0.0:1717018780.134345:0:20059:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1717018780.134361:0:20059:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:0.0:1717018780.134389:0:20059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134395:0:20059:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.134402:0:20059:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018780.134420:0:20059:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa64740 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:20059:1800422838658816:192.168.203.126@tcp:101:bash.0 00000100:00100000:0.0:1717018780.134479:0:20059:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b0240 going to sleep for 87 seconds 00000100:00100000:1.0:1717018780.136765:0:20059:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa64740 pname:cluuid:pid:xid:nid:opc:job bash:12cff408-c572-49fa-81b0-09052c8e7f41:20059:1800422838658816:192.168.203.126@tcp:101:bash.0 00010000:00010000:1.0:1717018780.136786:0:20059:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136795:0:20059:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136804:0:20059:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136811:0:20059:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136818:0:20059:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136823:0:20059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136827:0:20059:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00000002:00100000:1.0:1717018780.136834:0:20059:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff88012fa64740 x1800422838658816/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 576/688 e 0 to 0 dl 1717018869 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:1.0:1717018780.136852:0:20059:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136861:0:20059:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:1.0:1717018780.136885:0:20059:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:1.0:1717018780.136890:0:20059:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a366c8 00000080:00010000:1.0:1717018780.136895:0:20059:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018780.136898:0:20059:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a366c8 from it ffff88012c7dbcf8 00010000:00010000:1.0:1717018780.136899:0:20059:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.136904:0:20059:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018780.140453:0:20220:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018780.140476:0:20220:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018780.140491:0:20220:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140503:0:20220:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018780.140513:0:20220:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018780.140515:0:20220:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018780.140522:0:20220:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8e57b58 00010000:00010000:1.0:1717018780.140525:0:20220:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140538:0:20220:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018780.140551:0:20220:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:1.0:1717018780.140561:0:20220:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=1536 00000080:00200000:1.0:1717018780.140564:0:20220:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018780.140568:0:20220:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018780.140571:0:20220:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140577:0:20220:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018780.140618:0:20220:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018780.140619:0:20220:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018780.140622:0:20220:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8e57bf8 00010000:00010000:1.0:1717018780.140623:0:20220:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140628:0:20220:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018780.140633:0:20220:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717018780.140637:0:20220:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:1.0:1717018780.140640:0:20220:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1717018780.140643:0:20220:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140656:0:20220:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1717018780.140662:0:20220:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:1.0:1717018780.140664:0:20220:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:1.0:1717018780.140666:0:20220:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a8e57da0 00010000:00010000:1.0:1717018780.140668:0:20220:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140672:0:20220:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1717018780.140678:0:20220:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 3 00000080:00200000:1.0:1717018780.140682:0:20220:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8) 00800000:00000004:1.0:1717018780.140694:0:20220:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800b604b800: age 1548, max_age 0 00010000:00010000:1.0:1717018780.140744:0:20220:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018780.140752:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838658880:192.168.203.126@tcp:41:mkdir.0 00010000:00010000:1.0:1717018780.140756:0:20220:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140780:0:20220:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018780.140785:0:20220:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018780.140786:0:20220:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a893af40/0xe1aedd3f13a366c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0x81e56358f42c151a expref: -99 pid: 20059 timeout: 0 lvb_type: 0 00000020:00100000:1.0:1717018780.140800:0:20220:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:1.0:1717018780.140808:0:20220:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a93e2600 x1800422838659008/t0(0) o36->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:1.0:1717018780.140822:0:20220:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a93e2600 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:20220:1800422838659008:192.168.203.126@tcp:36:mkdir.0 00000100:00100000:1.0:1717018780.140842:0:20220:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9387cc0 going to sleep for 87 seconds 00000100:00100000:0.0:1717018780.144821:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e4740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838658880:192.168.203.126@tcp:41:mkdir.0 00000100:00100000:1.0:1717018780.144954:0:20220:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a93e2600 pname:cluuid:pid:xid:nid:opc:job mkdir:12cff408-c572-49fa-81b0-09052c8e7f41:20220:1800422838659008:192.168.203.126@tcp:36:mkdir.0 00000080:00200000:1.0:1717018780.144986:0:20220:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2cea:0x0](ffff880136ed3718) 00000080:00200000:1.0:1717018780.144991:0:20220:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cea:0x0], updating i_size 512 00000080:00200000:3.0:1717018780.150997:0:20221:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018780.151018:0:20221:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018780.151033:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.151045:0:20221:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018780.151055:0:20221:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018780.151057:0:20221:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018780.151063:0:20221:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a836faf8 00010000:00010000:3.0:1717018780.151066:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.151072:0:20221:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018780.151084:0:20221:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:3.0:1717018780.151094:0:20221:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), flags=16 00000080:00200000:3.0:1717018780.151097:0:20221:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff880136ed00d8), intent=0 00000002:00010000:3.0:1717018780.151104:0:20221:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22a.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018780.151143:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.151149:0:20221:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.151163:0:20221:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018780.151196:0:20221:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a22140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659072:192.168.203.126@tcp:101:lfs.0 00000100:00100000:3.0:1717018780.151846:0:20221:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffdc00 going to sleep for 87 seconds 00000100:00100000:3.0:1717018780.155265:0:20221:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a22140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659072:192.168.203.126@tcp:101:lfs.0 00010000:00010000:3.0:1717018780.155287:0:20221:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155303:0:20221:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155308:0:20221:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155317:0:20221:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155325:0:20221:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155333:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155339:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155344:0:20221:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1717018780.155375:0:20221:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff880136a22140 x1800422838659072/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018869 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1717018780.155385:0:20221:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155397:0:20221:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 4 res 8589935617/11498 (0 0) 00000080:00200000:3.0:1717018780.155418:0:20221:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2cea:0x0], updating i_size 512 00000080:00200000:3.0:1717018780.155421:0:20221:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x2cea:0x0](ffff880136ed3718): rc = 0 00000080:00010000:3.0:1717018780.155426:0:20221:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2cea:0x0](ffff880136ed3718) for lock 0xe1aedd3f13a366cf 00000080:00010000:3.0:1717018780.155438:0:20221:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x2cea:0x0](ffff880136ed3718) 00000080:00010000:3.0:1717018780.155441:0:20221:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a366cf from it ffff8800a836fa70 00010000:00010000:3.0:1717018780.155442:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155449:0:20221:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85ca1c0/0xe1aedd3f13a366cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cea:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1544 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018780.155475:0:20221:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cea:0x0](ffff880136ed3718), inode mode 41ed mask 1 00000080:00200000:3.0:1717018780.155486:0:20221:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x2cea:0x0](ffff880136ed3718), flags=0 00000080:00200000:3.0:1717018780.155490:0:20221:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x2cea:0x0](ffff880136ed3718), intent=getattr 00000002:00010000:3.0:1717018780.155500:0:20221:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22a.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x2cea:0x0], intent: getattr flags 0 00010000:00010000:3.0:1717018780.155533:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155538:0:20221:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.155553:0:20221:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018780.155620:0:20221:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a22140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659136:192.168.203.126@tcp:101:lfs.0 00000100:00100000:3.0:1717018780.155665:0:20221:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffdc00 going to sleep for 87 seconds 00000100:00100000:3.0:1717018780.158993:0:20221:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a22140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659136:192.168.203.126@tcp:101:lfs.0 00010000:00010000:3.0:1717018780.159014:0:20221:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159026:0:20221:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159031:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159035:0:20221:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159041:0:20221:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159046:0:20221:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85c8900 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:3.0:1717018780.159049:0:20221:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159054:0:20221:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159071:0:20221:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159076:0:20221:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1717018780.159079:0:20221:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159083:0:20221:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8900/0xe1aedd3f13a366d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1717018780.159097:0:20221:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff880136a22140 x1800422838659136/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 584/640 e 0 to 0 dl 1717018869 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:3.0:1717018780.159128:0:20221:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 30 res 8589935617/11498 (0 0) 00000080:00200000:3.0:1717018780.159208:0:20221:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8),name=/ 00000002:00010000:3.0:1717018780.159219:0:20221:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1717018780.159226:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159235:0:20221:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1717018780.159242:0:20221:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) 00000080:00010000:3.0:1717018780.159244:0:20221:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136ed00d8) for lock 0xe1aedd3f13a361c7 00000080:00010000:3.0:1717018780.159248:0:20221:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a361c7 from it ffff8800a836fbb0 00010000:00010000:3.0:1717018780.159251:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159256:0:20221:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff880130e36f40/0xe1aedd3f13a361c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42bff1e expref: -99 pid: 10059 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018780.159271:0:20221:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136ed00d8), inode mode 41ed mask 1 00000080:00200000:3.0:1717018780.159277:0:20221:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d22a.sanity-pfl, flags=17 00000080:00200000:3.0:1717018780.159280:0:20221:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cea:0x0](ffff880136ed3718), inode mode 41ed mask 1 00000080:00200000:3.0:1717018780.159288:0:20221:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2cea:0x0](ffff880136ed3718), inode mode 41ed mask 3 00000080:00200000:3.0:1717018780.159292:0:20221:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x2cea:0x0](ffff880136ed3718), file ffff8800b01e7200, open_flags a141, mode 81b6 opened 0 00000080:00200000:3.0:1717018780.159300:0:20221:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x2cea:0x0](ffff880136ed3718), intent=open|creat 00000002:00010000:3.0:1717018780.159312:0:20221:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22a.sanity-pfl,[0x200000401:0x2ceb:0x0]) in obj [0x200000401:0x2cea:0x0], intent: open|creat flags 0120502 00010000:00010000:3.0:1717018780.159347:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.159365:0:20221:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1717018780.159375:0:20221:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1717018780.159379:0:20221:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880136a22140 x1800422838659264/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1717018780.159386:0:20221:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018780.159403:0:20221:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a22140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659264:192.168.203.126@tcp:101:lfs.0 00000100:00100000:3.0:1717018780.159520:0:20221:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffdc00 going to sleep for 87 seconds 00000100:00100000:3.0:1717018780.162624:0:20221:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a22140 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659264:192.168.203.126@tcp:101:lfs.0 00010000:00010000:3.0:1717018780.162647:0:20221:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162663:0:20221:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162677:0:20221:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 4/0,1 mode: --/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162686:0:20221:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162694:0:20221:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162703:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162709:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162714:0:20221:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1717018780.162722:0:20221:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff880136a22140 x1800422838659264/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018869 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:3.0:1717018780.162732:0:20221:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff880136a22140 x1800422838659264/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018869 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:3.0:1717018780.162741:0:20221:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162750:0:20221:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800aac5d000 type 13 mode 16 res 8589935617/11499 (0 0) 00000080:00200000:3.0:1717018780.162769:0:20221:0:(namei.c:1405:ll_create_it()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x2cea:0x0](ffff880136ed3718), intent=open|creat 00000080:00200000:3.0:1717018780.162792:0:20221:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x2ceb:0x0](ffff8800b0a64698) 00000080:00200000:3.0:1717018780.162797:0:20221:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x2ceb:0x0], updating i_size 0 00000080:00200000:3.0:1717018780.162824:0:20221:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x2ceb:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:3.0:1717018780.162829:0:20221:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x2ceb:0x0](ffff8800b0a64698) 00000080:00010000:3.0:1717018780.162831:0:20221:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x2ceb:0x0](ffff8800b0a64698) for lock 0xe1aedd3f13a366dd 00000080:00200000:3.0:1717018780.162843:0:20221:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x2ceb:0x0](ffff8800b0a64698), flags 120501 00000002:00100000:3.0:1717018780.162854:0:20221:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff880136a22140 x1800422838659264/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018869 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:3.0:1717018780.162942:0:20221:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe1aedd3f13a366dd from it ffff8800b43241e0 00010000:00010000:3.0:1717018780.162945:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.162952:0:20221:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1717018780.162967:0:20221:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2ceb:0x0](ffff8800b0a64698), inode mode 81a4 mask 40 00000080:00200000:3.0:1717018780.163038:0:20221:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x2ceb:0x0](ffff8800b0a64698), inode mode 81a4 mask 2 00000080:00200000:3.0:1717018780.163047:0:20221:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x2ceb:0x0](ffff8800b0a64698), xattr lov 00000002:00010000:3.0:1717018780.163058:0:20221:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x2ceb:0x0]) in obj [0x200000401:0x2cea:0x0], intent: open flags 040000002 00010000:00010000:3.0:1717018780.163097:0:20221:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018780.163103:0:20221:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1717018780.163112:0:20221:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:3.0:1717018780.163116:0:20221:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff880136a22ac0 x1800422838659392/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:3.0:1717018780.163129:0:20221:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018780.163147:0:20221:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880136a22ac0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659392:192.168.203.126@tcp:101:lfs.0 00000100:00100000:3.0:1717018780.163205:0:20221:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800aaffdf00 going to sleep for 87 seconds 00000100:00100000:2.0:1717018780.166578:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.126@tcp (source: 12345-192.168.203.126@tcp) 00000100:00100000:3.0:1717018780.166755:0:4622:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1717018780.166777:0:4622:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819874880 00000100:00100000:3.0:1717018780.166825:0:4622:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.126@tcp, seq: 77853 00000100:00100000:3.0:1717018780.166830:0:4622:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800aaf02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:12cff408-c572-49fa-81b0-09052c8e7f41+5:8489:x1800422819874880:12345-192.168.203.126@tcp:104: 00010000:00010000:3.0:1717018780.166891:0:4622:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018780.166896:0:4622:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800aaf02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:12cff408-c572-49fa-81b0-09052c8e7f41+5:8489:x1800422819874880:12345-192.168.203.126@tcp:104: Request processed in 66us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018780.166901:0:4622:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.126@tcp, seq: 77853 00010000:00010000:0.0:1717018780.166910:0:4630:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018780.166916:0:4630:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.166926:0:4630:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85cb3c0 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018780.166931:0:4630:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.166946:0:4630:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.166958:0:4630:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1717018780.166982:0:4630:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x2ceb:0x0]: losing layout lock 00010000:00010000:0.0:1717018780.167016:0:4630:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.167021:0:4630:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018780.167051:0:4630:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.167057:0:4630:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85cb3c0/0xe1aedd3f13a366dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2ceb:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0x81e56358f42c1575 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018780.167073:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018780.167074:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018780.167075:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018780.167082:0:1833:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1717018780.167097:0:1833:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838659456:192.168.203.126@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1717018780.171288:0:1833:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa66d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:12cff408-c572-49fa-81b0-09052c8e7f41:1833:1800422838659456:192.168.203.126@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1717018780.482922:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018781.485275:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018782.486818:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018783.124599:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659584:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018783.124609:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838659520:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018783.124669:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838659648:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018783.124672:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659712:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018783.127110:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659584:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018783.127188:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659712:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018783.127302:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838659520:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018783.127314:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838659648:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018783.488789:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018784.490841:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018785.493341:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018786.497960:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018787.498763:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018788.130772:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838659776:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018788.130778:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659840:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018788.130845:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659968:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018788.130848:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838659904:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018788.135446:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838659776:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018788.135464:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838659904:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018788.135534:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8975a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659840:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018788.135544:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838659968:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018788.502055:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018789.504772:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018790.507018:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018791.508943:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018792.510787:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018793.136775:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838660032:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018793.136775:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660096:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018793.136844:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838660160:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018793.136846:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660224:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018793.140129:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660096:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018793.140142:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660224:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018793.140632:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8974280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838660032:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018793.140641:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8976880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838660160:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018793.512761:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018794.514827:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018795.516897:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018796.518775:0:10309:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018797.523384:0:10237:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018798.146508:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838660288:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018798.147287:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660352:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018798.147316:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660480:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018798.147364:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838660416:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018798.150251:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89750c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:461e9689-0dac-4669-87c3-00abdddc539f:1836:1800422838660288:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018798.150641:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660352:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018798.150649:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8973900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:12cff408-c572-49fa-81b0-09052c8e7f41:1835:1800422838660480:192.168.203.126@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018798.151627:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8970980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:12cff408-c572-49fa-81b0-09052c8e7f41:1836:1800422838660416:192.168.203.126@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1717018798.524745:0:4629:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018799.526773:0:4630:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018800.171887:0:20221:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880136a22ac0 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838659392:192.168.203.126@tcp:101:lfs.0 00010000:00010000:0.0:1717018800.171907:0:20221:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171934:0:20221:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171939:0:20221:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 4/1,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171945:0:20221:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171952:0:20221:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171957:0:20221:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a85c8b40 already unused, calling callback (ffffffffa0fbc120) 00010000:00010000:0.0:1717018800.171961:0:20221:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171966:0:20221:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171972:0:20221:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 5/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171978:0:20221:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1717018800.171982:0:20221:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018800.171986:0:20221:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b604b800 lock: ffff8800a85c8b40/0xe1aedd3f13a366e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cea:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20221 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1717018800.172023:0:20221:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff880136a22ac0 x1800422838659392/t0(0) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 1104/600 e 0 to 0 dl 1717018869 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1717018800.172041:0:20221:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1717018800.172136:0:20221:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x2ceb:0x0](ffff8800b0a64698) 00000002:00100000:0.0:1717018800.172161:0:20221:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff880136a22140 x1800422838659264/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018869 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1717018800.172181:0:20221:0:(genops.c:2337:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800b604b800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1717018800.172185:0:20221:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012fa66d40 x1800422838660608/t0(0) o35->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1717018800.172201:0:20221:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012fa66d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838660608:192.168.203.126@tcp:35:lfs.0 00000100:00100000:0.0:1717018800.172262:0:20221:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e1b06c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018800.174449:0:20221:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012fa66d40 pname:cluuid:pid:xid:nid:opc:job lfs:12cff408-c572-49fa-81b0-09052c8e7f41:20221:1800422838660608:192.168.203.126@tcp:35:lfs.0 00000002:00100000:0.0:1717018800.174477:0:20221:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff880136a22140 x1800422838659264/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800b604b800@192.168.203.126@tcp:12/10 lens 528/600 e 0 to 0 dl 1717018869 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:1.0:1717018800.529166:0:10278:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1717018800.696438:0:20368:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1717018800.696442:0:20368:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22a: @@@@@@ FAIL: Create /mnt/lustre/d22a.sanity-pfl/f22a.sanity-pfl failed Debug log: 369 lines, 369 kept, 0 dropped, 0 bad.