00010000:00010000:2.0F:1721219244.084829:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1721219244.538949:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511255616:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0F:1721219244.538949:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511255552:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219244.539093:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511255744:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219244.539093:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511255680:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219244.541026:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511255552:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219244.541043:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511255680:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219244.541085:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511255616:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219244.541097:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511255744:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1721219245.086892:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219246.088914:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219247.090866:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219248.093005:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1721219249.094995:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219249.546875:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511255872:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219249.546965:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511255808:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219249.547012:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8629300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511255936:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219249.547016:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511256000:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219249.548957:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511255808:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219249.548974:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8629300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511255936:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219249.549009:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511255872:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219249.549022:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511256000:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1721219250.096920:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219251.098954:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219252.100945:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219253.103020:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219254.105049:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219254.554873:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511256128:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219254.554892:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511256064:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219254.554965:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a862c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511256256:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219254.554978:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511256192:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219254.556709:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1835:1804827511256064:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219254.556759:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86284c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511256192:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219254.556861:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511256128:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219254.556881:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a862c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511256256:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219255.106876:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219256.108846:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1721219257.041625:0:20304:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219257.041631:0:20304:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22a: Test repeat component behavior with degraded OST ========================================================== 08:27:36 (1721219256) 00000080:00200000:2.0:1721219257.093530:0:20168:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:2.0:1721219257.093553:0:20168:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1721219257.093569:0:20168:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.093583:0:20168:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1721219257.093595:0:20168:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:2.0:1721219257.093598:0:20168:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:2.0:1721219257.093605:0:20168:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff8800a88f7af8 00010000:00010000:2.0:1721219257.093608:0:20168:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.093615:0:20168:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1721219257.093629:0:20168:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:2.0:1721219257.093637:0:20168:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1 00000080:00200000:2.0:1721219257.093641:0:20168:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=getattr 00000002:00010000:2.0:1721219257.093648:0:20168:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22a.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1721219257.093721:0:20168:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.093737:0:20168:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.093748:0:20168:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219257.093797:0:20168:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8602140 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20168:1804827511256320:192.168.201.158@tcp:101:bash.0 00000100:00100000:2.0:1721219257.093876:0:20168:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162000 going to sleep for 90 seconds 00000100:00100000:3.0:1721219257.096132:0:20168:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8602140 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20168:1804827511256320:192.168.201.158@tcp:101:bash.0 00010000:00010000:3.0:1721219257.096149:0:20168:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096161:0:20168:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096167:0:20168:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096173:0:20168:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096180:0:20168:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096187:0:20168:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a9bae1c0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:3.0:1721219257.096191:0:20168:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096197:0:20168:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096203:0:20168:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096209:0:20168:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1721219257.096213:0:20168:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096226:0:20168:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bae1c0/0xe0b47d8ca5f72a59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219257.096241:0:20168:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff8800a8602140 x1804827511256320/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219348 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'bash.0' 00010000:00010000:3.0:1721219257.096264:0:20168:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00000080:00200000:3.0:1721219257.096358:0:20168:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219257.096366:0:20168:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1721219257.096372:0:20168:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589934599/1 (0 0) 00010000:00010000:3.0:1721219257.096395:0:20168:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096402:0:20168:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.096409:0:20168:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219257.096422:0:20168:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89876c0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20168:1804827511256384:192.168.201.158@tcp:101:bash.0 00000100:00100000:3.0:1721219257.096462:0:20168:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a89400c0 going to sleep for 90 seconds 00000100:00100000:3.0:1721219257.098072:0:20168:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89876c0 pname:cluuid:pid:xid:nid:opc:job bash:2df8dc7e-94ba-4991-a575-93aaf526cb45:20168:1804827511256384:192.168.201.158@tcp:101:bash.0 00010000:00010000:3.0:1721219257.098087:0:20168:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098098:0:20168:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098121:0:20168:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098129:0:20168:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098136:0:20168:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098142:0:20168:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098148:0:20168:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00000002:00100000:3.0:1721219257.098156:0:20168:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=b, status=0 req@ffff8800a89876c0 x1804827511256384/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 576/688 e 0 to 0 dl 1721219348 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'bash.0' 00000002:00010000:3.0:1721219257.098166:0:20168:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098175:0:20168:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589934599/1 (0 0) 00000080:00200000:3.0:1721219257.098196:0:20168:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 13824 00000080:00010000:3.0:1721219257.098202:0:20168:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f72a60 00000080:00010000:3.0:1721219257.098205:0:20168:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219257.098208:0:20168:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72a60 from it ffff8800a88f7cf8 00010000:00010000:3.0:1721219257.098209:0:20168:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.098225:0:20168:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219257.102187:0:20328:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219257.102199:0:20328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219257.102207:0:20328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102216:0:20328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219257.102224:0:20328:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219257.102226:0:20328:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219257.102230:0:20328:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012b527b58 00010000:00010000:3.0:1721219257.102232:0:20328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102239:0:20328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219257.102248:0:20328:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:3.0:1721219257.102254:0:20328:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=1536 00000080:00200000:3.0:1721219257.102257:0:20328:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219257.102260:0:20328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219257.102264:0:20328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102270:0:20328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219257.102283:0:20328:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219257.102285:0:20328:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219257.102288:0:20328:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012b527bf8 00010000:00010000:3.0:1721219257.102290:0:20328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102295:0:20328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219257.102302:0:20328:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:3.0:1721219257.102306:0:20328:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:3.0:1721219257.102309:0:20328:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:3.0:1721219257.102313:0:20328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102318:0:20328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1721219257.102324:0:20328:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:3.0:1721219257.102326:0:20328:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:3.0:1721219257.102328:0:20328:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012b527da0 00010000:00010000:3.0:1721219257.102329:0:20328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102335:0:20328:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1721219257.102341:0:20328:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 3 00000080:00200000:3.0:1721219257.102349:0:20328:0:(namei.c:1899:ll_mkdir()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8) 00800000:00000004:3.0:1721219257.102361:0:20328:0:(obd_class.h:1039:obd_statfs_async()) lustre-MDT0000-mdc-ffff8800af021000: age 1462, max_age 0 00000100:00100000:3.0:1721219257.102413:0:1836:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1721219257.102427:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511256448:192.168.201.158@tcp:41:mkdir.0 00010000:00010000:3.0:1721219257.102482:0:20328:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102497:0:20328:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102524:0:20328:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219257.102531:0:20328:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219257.102533:0:20328:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff88012f87b180/0xe0b47d8ca5f72a60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x4809400000000 nid: local remote: 0xd4836d281e001643 expref: -99 pid: 20168 timeout: 0 lvb_type: 0 00000020:00100000:3.0:1721219257.102546:0:20328:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 36, max 7 00000100:00100000:3.0:1721219257.102552:0:20328:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a89850c0 x1804827511256576/t0(0) o36->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 512/448 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:3.0:1721219257.102566:0:20328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a89850c0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:20328:1804827511256576:192.168.201.158@tcp:36:mkdir.0 00000100:00100000:3.0:1721219257.102592:0:20328:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a89400c0 going to sleep for 90 seconds 00000100:00100000:3.0:1721219257.103819:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89876c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511256448:192.168.201.158@tcp:41:mkdir.0 00000100:00100000:3.0:1721219257.105410:0:20328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a89850c0 pname:cluuid:pid:xid:nid:opc:job mkdir:2df8dc7e-94ba-4991-a575-93aaf526cb45:20328:1804827511256576:192.168.201.158@tcp:36:mkdir.0 00000080:00200000:3.0:1721219257.105437:0:20328:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a13:0x0](ffff8800b05ef518) 00000080:00200000:3.0:1721219257.105442:0:20328:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a13:0x0], updating i_size 512 00000080:00200000:2.0:1721219257.110327:0:20329:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:2.0:1721219257.110339:0:20329:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1721219257.110348:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.110359:0:20329:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1721219257.110368:0:20329:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:2.0:1721219257.110370:0:20329:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:2.0:1721219257.110374:0:20329:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012da47af8 00010000:00010000:2.0:1721219257.110377:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.110383:0:20329:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1721219257.110393:0:20329:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:2.0:1721219257.110399:0:20329:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), flags=16 00000080:00200000:2.0:1721219257.110402:0:20329:0:(namei.c:833:ll_lookup_it()) VFS Op:name=d22a.sanity-pfl, dir=[0x200000007:0x1:0x0](ffff8800b05e80d8), intent=0 00000002:00010000:2.0:1721219257.110415:0:20329:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: d22a.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:2.0:1721219257.110437:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.110444:0:20329:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219257.110452:0:20329:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219257.110467:0:20329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86050c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256640:192.168.201.158@tcp:101:lfs.0 00000100:00100000:2.0:1721219257.110520:0:20329:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b6162600 going to sleep for 90 seconds 00010000:00010000:3.0:1721219257.110805:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219257.112620:0:20329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86050c0 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256640:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219257.112635:0:20329:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112650:0:20329:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112696:0:20329:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112711:0:20329:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112719:0:20329:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112727:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112733:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 5/2,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112741:0:20329:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219257.112750:0:20329:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=10 disposition=b, status=0 req@ffff8800a86050c0 x1804827511256640/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219348 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219257.112760:0:20329:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112767:0:20329:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 4 res 8589935617/27155 (0 0) 00000080:00200000:0.0:1721219257.112811:0:20329:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a13:0x0], updating i_size 512 00000080:00200000:0.0:1721219257.112814:0:20329:0:(namei.c:157:ll_iget()) got inode: [0x200000401:0x6a13:0x0](ffff8800b05ef518): rc = 0 00000080:00010000:0.0:1721219257.112818:0:20329:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a13:0x0](ffff8800b05ef518) for lock 0xe0b47d8ca5f72a67 00000080:00010000:0.0:1721219257.112824:0:20329:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000401:0x6a13:0x0](ffff8800b05ef518) 00000080:00010000:0.0:1721219257.112827:0:20329:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72a67 from it ffff88012da47a70 00010000:00010000:0.0:1721219257.112828:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112841:0:20329:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a9bad440/0xe0b47d8ca5f72a67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a13:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00166d expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219257.112861:0:20329:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a13:0x0](ffff8800b05ef518), inode mode 41ed mask 1 00000080:00200000:0.0:1721219257.112869:0:20329:0:(namei.c:1107:ll_lookup_nd()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x6a13:0x0](ffff8800b05ef518), flags=0 00000080:00200000:0.0:1721219257.112872:0:20329:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x6a13:0x0](ffff8800b05ef518), intent=getattr 00000002:00010000:0.0:1721219257.112880:0:20329:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22a.sanity-pfl,[0x0:0x0:0x0]) in obj [0x200000401:0x6a13:0x0], intent: getattr flags 0 00010000:00010000:0.0:1721219257.112903:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112909:0:20329:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.112916:0:20329:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219257.112930:0:20329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256704:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219257.112981:0:20329:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0300 going to sleep for 90 seconds 00000100:00100000:0.0:1721219257.114923:0:20329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256704:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219257.114936:0:20329:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114947:0:20329:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114953:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114968:0:20329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114974:0:20329:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114980:0:20329:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8dec000 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219257.114982:0:20329:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114987:0:20329:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114993:0:20329:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.114998:0:20329:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219257.115001:0:20329:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.115006:0:20329:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dec000/0xe0b47d8ca5f72a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x2/0x2 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219257.115019:0:20329:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=8 disposition=7, status=0 req@ffff88012b17b440 x1804827511256704/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 584/640 e 0 to 0 dl 1721219348 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00010000:00010000:0.0:1721219257.115038:0:20329:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 30 res 8589935617/27155 (0 0) 00000080:00200000:0.0:1721219257.115081:0:20329:0:(file.c:5211:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8),name=/ 00000002:00010000:0.0:1721219257.115088:0:20329:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1721219257.115100:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.115108:0:20329:0:(ldlm_lock.c:1494:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1721219257.115115:0:20329:0:(dcache.c:296:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) 00000080:00010000:0.0:1721219257.115118:0:20329:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b05e80d8) for lock 0xe0b47d8ca5f7255f 00000080:00010000:0.0:1721219257.115122:0:20329:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f7255f from it ffff88012da47bb0 00010000:00010000:0.0:1721219257.115123:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.115129:0:20329:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8dedb00/0xe0b47d8ca5f7255f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e000047 expref: -99 pid: 10237 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219257.115138:0:20329:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b05e80d8), inode mode 41ed mask 1 00000080:00200000:0.0:1721219257.115142:0:20329:0:(dcache.c:312:ll_revalidate_dentry()) VFS Op:name=d22a.sanity-pfl, flags=17 00000080:00200000:0.0:1721219257.115145:0:20329:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a13:0x0](ffff8800b05ef518), inode mode 41ed mask 1 00000080:00200000:0.0:1721219257.115151:0:20329:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a13:0x0](ffff8800b05ef518), inode mode 41ed mask 3 00000080:00200000:0.0:1721219257.115154:0:20329:0:(namei.c:1176:ll_atomic_open()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x6a13:0x0](ffff8800b05ef518), file ffff880097a66180, open_flags a141, mode 81b6 opened 0 00000080:00200000:0.0:1721219257.115160:0:20329:0:(namei.c:833:ll_lookup_it()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x6a13:0x0](ffff8800b05ef518), intent=open|creat 00000002:00010000:0.0:1721219257.115170:0:20329:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: f22a.sanity-pfl,[0x200000401:0x6a14:0x0]) in obj [0x200000401:0x6a13:0x0], intent: open|creat flags 0120502 00010000:00010000:0.0:1721219257.115196:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.115202:0:20329:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219257.115210:0:20329:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219257.115220:0:20329:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b17b440 x1804827511256832/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219257.115228:0:20329:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219257.115242:0:20329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256832:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219257.115370:0:20329:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0300 going to sleep for 90 seconds 00000100:00100000:0.0:1721219257.117582:0:20329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17b440 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256832:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219257.117597:0:20329:0:(ldlm_request.c:717:ldlm_cli_enqueue_fini()) ### server returned different mode CR ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117611:0:20329:0:(ldlm_request.c:732:ldlm_cli_enqueue_fini()) ### client-side enqueue, new resource ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117617:0:20329:0:(ldlm_request.c:745:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 4/0,1 mode: --/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117624:0:20329:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117631:0:20329:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 4/0,1 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117639:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117645:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 5/1,1 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117691:0:20329:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219257.117700:0:20329:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=3 disposition=8000037, status=0 req@ffff88012b17b440 x1804827511256832/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219348 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00100000:0.0:1721219257.117711:0:20329:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012b17b440 x1804827511256832/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219348 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000002:00010000:0.0:1721219257.117721:0:20329:0:(mdc_locks.c:1179:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117728:0:20329:0:(ldlm_lock.c:1511:ldlm_lock_match_with_skip()) ### not matched ns ffff8800b6ecf000 type 13 mode 16 res 8589935617/27156 (0 0) 00000080:00200000:0.0:1721219257.117739:0:20329:0:(namei.c:1405:ll_create_it()) VFS Op:name=f22a.sanity-pfl, dir=[0x200000401:0x6a13:0x0](ffff8800b05ef518), intent=open|creat 00000080:00200000:0.0:1721219257.117752:0:20329:0:(llite_lib.c:2834:ll_read_inode2()) VFS Op:inode=[0x200000401:0x6a14:0x0](ffff8800b061bed8) 00000080:00200000:0.0:1721219257.117756:0:20329:0:(llite_lib.c:2756:ll_update_inode()) inode=[0x200000401:0x6a14:0x0], updating i_size 0 00000080:00200000:0.0:1721219257.117812:0:20329:0:(file.c:5862:ll_layout_conf()) [0x200000401:0x6a14:0x0]: layout version change: 4294967294 -> 4294967295 00000080:00010000:0.0:1721219257.117818:0:20329:0:(namei.c:1372:ll_create_node()) setting l_ast_data to inode [0x200000401:0x6a14:0x0](ffff8800b061bed8) 00000080:00010000:0.0:1721219257.117821:0:20329:0:(llite_internal.h:1688:ll_set_lock_data()) setting l_data to inode [0x200000401:0x6a14:0x0](ffff8800b061bed8) for lock 0xe0b47d8ca5f72a75 00000080:00200000:0.0:1721219257.117830:0:20329:0:(file.c:833:ll_file_open()) VFS Op:inode=[0x200000401:0x6a14:0x0](ffff8800b061bed8), flags 120501 00000002:00100000:0.0:1721219257.117841:0:20329:0:(mdc_request.c:833:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012b17b440 x1804827511256832/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219348 ref 2 fl Complete:RPQU/4/0 rc 0/0 job:'lfs.0' 00000080:00010000:0.0:1721219257.117885:0:20329:0:(dcache.c:196:ll_intent_drop_lock()) releasing lock with cookie 0xe0b47d8ca5f72a75 from it ffff8800a9240540 00010000:00010000:0.0:1721219257.117888:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.117895:0:20329:0:(ldlm_lock.c:902:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219257.117918:0:20329:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a14:0x0](ffff8800b061bed8), inode mode 81a4 mask 40 00000080:00200000:0.0:1721219257.117964:0:20329:0:(file.c:5646:ll_inode_permission()) VFS Op:inode=[0x200000401:0x6a14:0x0](ffff8800b061bed8), inode mode 81a4 mask 2 00000080:00200000:0.0:1721219257.117972:0:20329:0:(xattr.c:358:ll_xattr_set()) VFS Op:inode=[0x200000401:0x6a14:0x0](ffff8800b061bed8), xattr lov 00000002:00010000:0.0:1721219257.117981:0:20329:0:(mdc_locks.c:1328:mdc_intent_lock()) (name: ,[0x200000401:0x6a14:0x0]) in obj [0x200000401:0x6a13:0x0], intent: open flags 040000002 00010000:00010000:0.0:1721219257.118008:0:20329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.118015:0:20329:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000020:00100000:0.0:1721219257.118023:0:20329:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1721219257.118028:0:20329:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012b17af80 x1804827511256960/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/66720 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' 00010000:00010000:0.0:1721219257.118035:0:20329:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219257.118048:0:20329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256960:192.168.201.158@tcp:101:lfs.0 00000100:00100000:0.0:1721219257.118123:0:20329:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0780 going to sleep for 90 seconds 00000100:00100000:3.0:1721219257.119843:0:1828:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1721219257.119946:0:4605:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459571648 00000100:00100000:2.0:1721219257.120001:0:4605:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 181498 00000100:00100000:2.0:1721219257.120008:0:4605:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a89876c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27341:x1804827459571648:12345-192.168.201.158@tcp:104: 00010000:00010000:2.0:1721219257.120067:0:4605:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1721219257.120073:0:4605:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a89876c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+5:27341:x1804827459571648:12345-192.168.201.158@tcp:104: Request processed in 66us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219257.120082:0:4605:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 181498 00010000:00010000:0.0:1721219257.120159:0:4613:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219257.120167:0:4613:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x420000000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.120178:0:4613:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8def3c0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219257.120181:0:4613:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.120188:0:4613:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x420400000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.120204:0:4613:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x428400000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1721219257.120220:0:4613:0:(vvp_object.c:137:vvp_conf_set()) [0x200000401:0x6a14:0x0]: losing layout lock 00010000:00010000:0.0:1721219257.120247:0:4613:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.120253:0:4613:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219257.120285:0:4613:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.120291:0:4613:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8def3c0/0xe0b47d8ca5f72a75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a14:0x0].0x0 bits 0x9/0x9 rrc: 2 type: IBT gid 0 flags: 0x4c29400000000 nid: local remote: 0xd4836d281e00169e expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219257.120306:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219257.120307:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219257.120309:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219257.120323:0:1834:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1721219257.120335:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257024:192.168.201.158@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1721219257.121475:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257024:192.168.201.158@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1721219258.112904:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219259.114963:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219259.563034:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511257152:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219259.563105:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8604740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511257088:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219259.563116:0:1837:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511257280:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219259.563166:0:1836:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a86076c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511257216:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219259.565166:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8604740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1836:1804827511257088:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219259.565182:0:1836:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a86076c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1836:1804827511257216:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219259.565203:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8606880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511257152:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219259.565216:0:1837:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8602ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1837:1804827511257280:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219260.116967:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219261.119029:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219262.120915:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219263.122840:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219264.125007:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219264.570854:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257408:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219264.570866:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511257344:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219264.570932:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9286d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257472:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219264.570932:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257536:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219264.572046:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257408:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219264.572057:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257536:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219264.572059:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511257344:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219264.572067:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9286d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257472:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:1.0:1721219265.126826:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219266.128837:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219267.130860:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219268.132844:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219269.134854:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219269.578893:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257664:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219269.578906:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9285580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511257600:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219269.578997:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9283900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257728:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219269.579000:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257792:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219269.580700:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9285580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511257600:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219269.580713:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9283900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257728:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219269.580732:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257664:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219269.580744:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257792:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:3.0:1721219270.136838:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219271.138808:0:4613:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219272.140831:0:11546:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219273.142857:0:4614:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219274.144875:0:11571:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219274.586833:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a92863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257920:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219274.586872:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511257856:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219274.586898:0:1834:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9283dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257984:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219274.586899:0:1835:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258048:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219274.588193:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38:1834:1804827511257856:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219274.588199:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a92863c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511257920:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219274.588201:0:1834:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9283dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2df8dc7e-94ba-4991-a575-93aaf526cb45:1834:1804827511257984:192.168.201.158@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219274.588205:0:1835:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2df8dc7e-94ba-4991-a575-93aaf526cb45:1835:1804827511258048:192.168.201.158@tcp:400:kworker/u8:2.0 00010000:00010000:2.0:1721219275.146812:0:11573:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219276.148788:0:9881:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219277.122241:0:20329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012b17af80 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511256960:192.168.201.158@tcp:101:lfs.0 00010000:00010000:0.0:1721219277.122256:0:20329:0:(ldlm_request.c:644:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122266:0:20329:0:(ldlm_request.c:565:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122270:0:20329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 4/1,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122274:0:20329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x10206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122289:0:20329:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122293:0:20329:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a8deeac0 already unused, calling callback (ffffffffa0fa2120) 00010000:00010000:0.0:1721219277.122295:0:20329:0:(ldlm_request.c:1508:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122299:0:20329:0:(ldlm_request.c:1518:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x206400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122302:0:20329:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 5/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x20e400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122306:0:20329:0:(ldlm_request.c:1251:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1721219277.122319:0:20329:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219277.122322:0:20329:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800af021000 lock: ffff8800a8deeac0/0xe0b47d8ca5f72a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a13:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT gid 0 flags: 0x4a0f400000000 nid: local remote: 0x0 expref: -99 pid: 20329 timeout: 0 lvb_type: 0 00000002:00100000:0.0:1721219277.122346:0:20329:0:(mdc_locks.c:743:mdc_finish_enqueue()) @@@ op=1 disposition=3, status=-28 req@ffff88012b17af80 x1804827511256960/t0(0) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 1104/600 e 0 to 0 dl 1721219348 ref 1 fl Complete:RQU/0/0 rc 301/301 job:'lfs.0' 00000080:00200000:0.0:1721219277.122359:0:20329:0:(file.c:694:ll_intent_file_open()) lock enqueue: err: -28 00000080:00200000:0.0:1721219277.122460:0:20329:0:(file.c:406:ll_file_release()) VFS Op:inode=[0x200000401:0x6a14:0x0](ffff8800b061bed8) 00000002:00100000:0.0:1721219277.122482:0:20329:0:(mdc_request.c:944:mdc_close()) @@@ matched open req@ffff88012b17b440 x1804827511256832/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219348 ref 1 fl Complete:RPQU/4/ffffffff rc 0/-1 job:'lfs.0' 00000020:00100000:0.0:1721219277.122499:0:20329:0:(genops.c:2339:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800af021000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1721219277.122502:0:20329:0:(client.c:742:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a9284c00 x1804827511258176/t0(0) o35->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:23/10 lens 392/1080 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' 00000100:00100000:0.0:1721219277.122519:0:20329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9284c00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511258176:192.168.201.158@tcp:35:lfs.0 00000100:00100000:0.0:1721219277.122564:0:20329:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b3ce0300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219277.123687:0:20329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a9284c00 pname:cluuid:pid:xid:nid:opc:job lfs:2df8dc7e-94ba-4991-a575-93aaf526cb45:20329:1804827511258176:192.168.201.158@tcp:35:lfs.0 00000002:00100000:0.0:1721219277.123695:0:20329:0:(mdc_request.c:854:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012b17b440 x1804827511256832/t12884902023(12884902023) o101->lustre-MDT0000-mdc-ffff8800af021000@192.168.201.158@tcp:12/10 lens 528/600 e 0 to 0 dl 1721219348 ref 1 fl Complete:RQU/4/ffffffff rc 0/-1 job:'lfs.0' 00010000:00010000:2.0:1721219277.150770:0:11574:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1721219277.451994:0:20477:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219277.451998:0:20477:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22a: @@@@@@ FAIL: Create /mnt/lustre/d22a.sanity-pfl/f22a.sanity-pfl failed Debug log: 366 lines, 366 kept, 0 dropped, 0 bad.