00000080:00200000:2.0F:1715206203.321645:0:20954:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715206203.321667:0:20954:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206203.321711:0:20954:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321720:0:20954:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321728:0:20954:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20954 initiator: MDT0 00000100:00100000:2.0:1715206203.321743:0:20954:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391780 going to sleep for 0 seconds 00000100:00100000:2.0:1715206203.321752:0:20954:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324700 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:20954:1798523503827008:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715206203.321761:0:20954:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321768:0:20954:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321774:0:20954:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321779:0:20954:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321785:0:20954:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321791:0:20954:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309440 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206203.321794:0:20954:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321799:0:20954:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321813:0:20954:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321818:0:20954:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206203.321823:0:20954:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20954 initiator: MDT0 00010000:00010000:2.0:1715206203.321828:0:20954:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309440/0xbbeffb005ec3dd5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20954 initiator: MDT0 00000080:00020000:2.0:1715206203.321846:0:20954:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:1.0F:1715206203.572146:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206204.574155:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206205.576101:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206206.578143:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0F:1715206207.052209:0:288:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206207.052225:0:288:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206207.052227:0:288:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206207.052230:0:288:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206207.052246:0:288:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1715206207.052247:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503827072:192.168.202.138@tcp:400:kworker.0 00000100:00080000:3.0:1715206207.052249:0:288:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715206207.052277:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503827136:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206207.052322:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503827200:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715206207.053812:0:1956:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967394 gen 1 00000100:00100000:2.0:1715206207.053831:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503827200:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715206207.053833:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503827136:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206207.053838:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503827072:192.168.202.138@tcp:400:kworker.0 00010000:00010000:1.0:1715206207.580998:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206208.141144:0:21791:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 8: Test default archive number ======== 18:10:07 (1715206207) 00000080:00200008:3.0:1715206208.206516:0:21834:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206208.206524:0:21834:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206208.206540:0:21834:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.206553:0:21834:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.206564:0:21834:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206208.206573:0:21834:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206208.206576:0:21834:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206208.206583:0:21834:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012db9bcc8 00010000:00010000:3.0:1715206208.206586:0:21834:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.206593:0:21834:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715206208.206883:0:21834:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206208.206886:0:21834:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206208.206894:0:21834:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.206925:0:21834:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206930:0:21834:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206936:0:21834:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21834 initiator: MDT0 00000100:00100000:3.0:1715206208.206946:0:21834:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b051e240 going to sleep for 0 seconds 00000100:00100000:3.0:1715206208.206953:0:21834:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21834:1798523503827264:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715206208.206960:0:21834:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206963:0:21834:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206967:0:21834:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206970:0:21834:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206973:0:21834:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206976:0:21834:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae77180 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206208.206979:0:21834:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206986:0:21834:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206990:0:21834:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.206993:0:21834:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206208.206996:0:21834:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21834 initiator: MDT0 00010000:00010000:3.0:1715206208.207000:0:21834:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae77180/0xbbeffb005ec3dd64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21834 initiator: MDT0 00000080:00020000:3.0:1715206208.207011:0:21834:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715206208.211702:0:21834:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715206208.211708:0:21834:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206208.211720:0:21834:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.211730:0:21834:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.211739:0:21834:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206208.211746:0:21834:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206208.211749:0:21834:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206208.211753:0:21834:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012db9bcc8 00010000:00010000:3.0:1715206208.211756:0:21834:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.211761:0:21834:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206208.211859:0:21834:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206208.211867:0:21834:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.211872:0:21834:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.211880:0:21834:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206208.211887:0:21834:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206208.211889:0:21834:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206208.211892:0:21834:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012db9bb80 00010000:00010000:3.0:1715206208.211895:0:21834:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.211901:0:21834:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206208.211908:0:21834:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715206208.211913:0:21834:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:2.0:1715206208.212513:0:21835:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:2.0:1715206208.212522:0:21835:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206208.212528:0:21835:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.212535:0:21835:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715206208.212540:0:21835:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:2.0:1715206208.212541:0:21835:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:2.0:1715206208.212544:0:21835:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012d463b80 00010000:00010000:2.0:1715206208.212549:0:21835:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.212553:0:21835:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715206208.212559:0:21835:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:2.0:1715206208.212562:0:21835:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:2.0:1715206208.212577:0:21835:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:2.0:1715206208.212580:0:21835:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206208.212584:0:21835:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.212588:0:21835:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715206208.212592:0:21835:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:2.0:1715206208.212593:0:21835:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:2.0:1715206208.212595:0:21835:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff88012d463bb0 00010000:00010000:2.0:1715206208.212596:0:21835:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.212600:0:21835:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715206208.212604:0:21835:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715206208.212607:0:21835:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:2.0:1715206208.212610:0:21835:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff88012e4b90c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715206208.212616:0:21835:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), file ffff8800b058d080, open_flags 8000, mode 0 opened 0 00000080:00200000:2.0:1715206208.212629:0:21835:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), intent=open 00000002:00010000:2.0:1715206208.212635:0:21835:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:2.0:1715206208.212666:0:21835:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.212673:0:21835:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21835 initiator: MDT0 00000020:00100000:2.0:1715206208.212681:0:21835:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1715206208.212689:0:21835:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b6324700 x1798523503827392/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1715206208.212698:0:21835:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21835 initiator: MDT0 00000100:00100000:2.0:1715206208.212713:0:21835:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324700 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21835:1798523503827392:192.168.202.138@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1715206208.212800:0:21835:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391540 going to sleep for 145 seconds 00000100:00100000:2.0:1715206208.214221:0:21835:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324700 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21835:1798523503827392:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715206208.214232:0:21835:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214241:0:21835:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214246:0:21835:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214252:0:21835:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214258:0:21835:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214266:0:21835:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309680 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206208.214270:0:21835:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214275:0:21835:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214281:0:21835:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214285:0:21835:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206208.214289:0:21835:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21835 initiator: MDT0 00010000:00010000:2.0:1715206208.214292:0:21835:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800aa309680/0xbbeffb005ec3dd6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21835 initiator: MDT0 00000002:00100000:2.0:1715206208.214301:0:21835:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800b6324700 x1798523503827392/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206358 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715206208.214309:0:21835:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b6324700 x1798523503827392/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206358 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715206208.214324:0:21835:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 10752 00000080:00200000:2.0:1715206208.214326:0:21835:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b08900c8): rc = 0 00000080:00010000:2.0:1715206208.214329:0:21835:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b08900c8) for lock 0x0 00000080:00200008:2.0:1715206208.214337:0:21835:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715206208.214344:0:21835:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800b6324700 x1798523503827392/t4294967395(4294967395) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206358 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715206208.214375:0:21835:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b08900c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715206208.214409:0:21835:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=c610f0 00800000:00000080:2.0:1715206208.214418:0:21835:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa1c6a20 uarg=0000000000000000 00000002:00000080:2.0:1715206208.214425:0:21835:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa1c6a20 uarg=0000000000000000 00000100:00100000:2.0:1715206208.214439:0:21835:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21835:1798523503827456:192.168.202.138@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715206208.214476:0:21835:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391f00 going to sleep for 145 seconds 00000100:00100000:1.0:1715206208.215155:0:21835:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21835:1798523503827456:192.168.202.138@tcp:59:lhsmtool_posix.0 00000080:00200000:2.0:1715206208.218389:0:21836:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715206208.218406:0:21836:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206208.218440:0:21836:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218448:0:21836:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218455:0:21836:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00000100:00100000:2.0:1715206208.218482:0:21836:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391000 going to sleep for 0 seconds 00000100:00100000:2.0:1715206208.218490:0:21836:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21836:1798523503827520:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715206208.218499:0:21836:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218505:0:21836:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218510:0:21836:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218516:0:21836:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218521:0:21836:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218539:0:21836:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa3098c0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206208.218543:0:21836:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218548:0:21836:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218554:0:21836:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218559:0:21836:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206208.218562:0:21836:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218567:0:21836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3098c0/0xbbeffb005ec3dd72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21836 initiator: MDT0 00000080:00020000:2.0:1715206208.218584:0:21836:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:2.0:1715206208.218604:0:21836:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715206208.218610:0:21836:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206208.218626:0:21836:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218632:0:21836:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218638:0:21836:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00000100:00100000:2.0:1715206208.218646:0:21836:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391000 going to sleep for 0 seconds 00000100:00100000:2.0:1715206208.218651:0:21836:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21836:1798523503827584:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715206208.218657:0:21836:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218666:0:21836:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218671:0:21836:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218676:0:21836:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218681:0:21836:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218686:0:21836:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309b00 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206208.218688:0:21836:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218693:0:21836:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218698:0:21836:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218703:0:21836:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206208.218706:0:21836:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218711:0:21836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309b00/0xbbeffb005ec3dd79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21836 initiator: MDT0 00000080:00020000:2.0:1715206208.218724:0:21836:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715206208.218739:0:21836:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715206208.218743:0:21836:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715206208.218753:0:21836:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206208.218768:0:21836:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218773:0:21836:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218779:0:21836:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00000100:00100000:2.0:1715206208.218787:0:21836:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391000 going to sleep for 0 seconds 00000100:00100000:2.0:1715206208.218791:0:21836:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21836:1798523503827648:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715206208.218797:0:21836:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218802:0:21836:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218807:0:21836:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218812:0:21836:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218817:0:21836:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218821:0:21836:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309d40 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206208.218824:0:21836:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218828:0:21836:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218842:0:21836:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218846:0:21836:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206208.218849:0:21836:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21836 initiator: MDT0 00010000:00010000:2.0:1715206208.218854:0:21836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309d40/0xbbeffb005ec3dd80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21836 initiator: MDT0 00000080:00020000:2.0:1715206208.218867:0:21836:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715206208.220722:0:21837:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715206208.220732:0:21837:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.220754:0:21837:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220761:0:21837:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220768:0:21837:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21837 initiator: MDT0 00000100:00100000:3.0:1715206208.220785:0:21837:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800b051e240 going to sleep for 0 seconds 00000100:00100000:3.0:1715206208.220791:0:21837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb800 pname:cluuid:pid:xid:nid:opc:job bash:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21837:1798523503827712:192.168.202.138@tcp:101:bash.0 00010000:00010000:3.0:1715206208.220798:0:21837:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220803:0:21837:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220809:0:21837:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220814:0:21837:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220820:0:21837:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220825:0:21837:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae76f40 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715206208.220828:0:21837:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220833:0:21837:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220838:0:21837:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220844:0:21837:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206208.220847:0:21837:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21837 initiator: MDT0 00010000:00010000:3.0:1715206208.220852:0:21837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae76f40/0xbbeffb005ec3dd87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21837 initiator: MDT0 00000080:00020000:3.0:1715206208.220873:0:21837:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0F:1715206208.222811:0:21838:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:0.0:1715206208.222826:0:21838:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715206208.222836:0:21838:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206208.222847:0:21838:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1715206208.222856:0:21838:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:0.0:1715206208.222859:0:21838:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:0.0:1715206208.222864:0:21838:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800aa3a3af8 00010000:00010000:0.0:1715206208.222867:0:21838:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206208.222874:0:21838:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1715206208.222886:0:21838:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:0.0:1715206208.222895:0:21838:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d8.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff880136f588c8), flags=16 00000080:00200000:0.0:1715206208.222899:0:21838:0:(namei.c:838:ll_lookup_it()) VFS Op:name=d8.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff880136f588c8), intent=0 00000002:00010000:0.0:1715206208.222907:0:21838:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: d8.sanity-hsm,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:0.0:1715206208.222929:0:21838:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 21838 initiator: MDT0 00010000:00010000:0.0:1715206208.222935:0:21838:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21838 initiator: MDT0 00010000:00010000:0.0:1715206208.222943:0:21838:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21838 initiator: MDT0 00000100:00100000:0.0:1715206208.222956:0:21838:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012aaf5180 pname:cluuid:pid:xid:nid:opc:job rm:cbae74da-7571-45ad-b971-0e0378bbd4e4:21838:1798523503827776:192.168.202.138@tcp:101:rm.0 00000100:00100000:0.0:1715206208.223029:0:21838:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeeea80 going to sleep for 145 seconds 00000100:00100000:2.0:1715206208.224581:0:21838:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf5180 pname:cluuid:pid:xid:nid:opc:job rm:cbae74da-7571-45ad-b971-0e0378bbd4e4:21838:1798523503827776:192.168.202.138@tcp:101:rm.0 00010000:00010000:2.0:1715206208.224590:0:21838:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224596:0:21838:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224600:0:21838:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224603:0:21838:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224606:0:21838:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224609:0:21838:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac2beac0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206208.224611:0:21838:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224614:0:21838:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224622:0:21838:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224625:0:21838:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206208.224627:0:21838:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21838 initiator: MDT0 00010000:00010000:2.0:1715206208.224630:0:21838:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2beac0/0xbbeffb005ec3dd8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21838 initiator: MDT0 00000002:00100000:2.0:1715206208.224639:0:21838:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=7, status=0 req@ffff88012aaf5180 x1798523503827776/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 584/584 e 0 to 0 dl 1715206358 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:2.0:1715206208.224655:0:21838:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.224660:0:21838:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715206208.224663:0:21838:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800aa3a3930 00010000:00010000:2.0:1715206208.224665:0:21838:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.224669:0:21838:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715206208.224712:0:21838:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:2.0:1715206208.224717:0:21838:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206208.224721:0:21838:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.224731:0:21838:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715206208.224736:0:21838:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:2.0:1715206208.224738:0:21838:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:2.0:1715206208.224740:0:21838:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800aa3a3b90 00010000:00010000:2.0:1715206208.224742:0:21838:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206208.224746:0:21838:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715206208.224750:0:21838:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715206208.224754:0:21838:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d8.sanity-hsm, flags=16 00000080:00200000:3.0:1715206208.227482:0:21839:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206208.227497:0:21839:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.227507:0:21839:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.227518:0:21839:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206208.227527:0:21839:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206208.227529:0:21839:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206208.227534:0:21839:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800aaea7af8 00010000:00010000:3.0:1715206208.227537:0:21839:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.227544:0:21839:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206208.227555:0:21839:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206208.227560:0:21839:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d8.sanity-hsm, flags=17 00000080:00200000:3.0:1715206208.227581:0:21839:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206208.227586:0:21839:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.227592:0:21839:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.227599:0:21839:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206208.227614:0:21839:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206208.227617:0:21839:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206208.227620:0:21839:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800aaea7af8 00010000:00010000:3.0:1715206208.227623:0:21839:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.227629:0:21839:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206208.227637:0:21839:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206208.227641:0:21839:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d8.sanity-hsm, flags=17 00000080:00200000:3.0:1715206208.227669:0:21839:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715206208.227675:0:21839:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206208.227680:0:21839:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.227687:0:21839:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715206208.227692:0:21839:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715206208.227695:0:21839:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3dd3a 00000080:00010000:3.0:1715206208.227697:0:21839:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3dd3a from it ffff8800aaea7bb0 00010000:00010000:3.0:1715206208.227700:0:21839:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206208.227706:0:21839:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3dd3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f660d9 expref: -99 pid: 20489 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715206208.227722:0:21839:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715206208.227726:0:21839:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d8.sanity-hsm, flags=17 00000001:02000400:1.0:1715206208.543022:0:21971:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_8: @@@@@@ FAIL: cannot create /mnt/lustre2/d8.sanity-hsm/f8.sanity-hsm with cp, status=1 00010000:00010000:1.0:1715206208.582142:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 315 lines, 315 kept, 0 dropped, 0 bad.