00010000:00010000:0.0F:1715208111.390287:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:2.0F:1715208111.883555:0:20567:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=a8e0f0 00800000:00000080:2.0:1715208111.883584:0:20567:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa2758a0 uarg=0000000000000000 00000002:00000080:2.0:1715208111.883593:0:20567:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa2758a0 uarg=0000000000000000 00000100:00100000:2.0:1715208111.883645:0:20567:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503951168:192.168.202.138@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208111.883738:0:20567:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1715208111.885504:0:20567:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503951168:192.168.202.138@tcp:60:lhsmtool_posix.0 00000080:00200008:2.0:1715208111.885540:0:20567:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715208111.885567:0:20567:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012a616680 x1798523503950912/t4294967503(4294967503) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208126 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:2.0:1715208111.885587:0:20567:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1715208111.885592:0:20567:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b6326d80 x1798523503951296/t0(0) o35->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715208111.885604:0:20567:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503951296:192.168.202.138@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715208111.885644:0:20567:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0000 going to sleep for 11 seconds 00000100:00100000:3.0F:1715208111.887287:0:20567:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503951296:192.168.202.138@tcp:35:lhsmtool_posix.0 00000002:00100000:3.0:1715208111.887325:0:20567:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012a616680 x1798523503950912/t4294967503(4294967503) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208126 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:3.0:1715208111.887378:0:20567:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200008:3.0:1715208111.890570:0:20567:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000100:00080000:2.0:1715208112.188209:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208112.188216:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208112.188219:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208112.188222:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208112.188231:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208112.188234:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715208112.188269:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503951424:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208112.188315:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503951360:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715208112.190143:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503951424:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208112.190221:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503951360:192.168.202.138@tcp:400:kworker.0 00010000:00010000:1.0F:1715208112.392231:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715208113.394164:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715208114.396279:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715208115.398225:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715208116.400194:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715208116.740244:0:21464:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 25b: Restore lost file (HS_LOST flag) after release ========================================================== 18:41:56 (1715208116) 00000080:00200008:3.0:1715208116.851597:0:21507:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208116.851607:0:21507:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208116.851626:0:21507:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208116.851643:0:21507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.851658:0:21507:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208116.851670:0:21507:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208116.851673:0:21507:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208116.851681:0:21507:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff8800aa3c3cc8 00010000:00010000:3.0:1715208116.851685:0:21507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.851693:0:21507:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715208116.852173:0:21507:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208116.852179:0:21507:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715208116.852194:0:21507:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208116.852237:0:21507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852245:0:21507:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852254:0:21507:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21507 initiator: MDT0 00000100:00100000:3.0:1715208116.852271:0:21507:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1a3c00 going to sleep for 0 seconds 00000100:00100000:3.0:1715208116.852281:0:21507:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21507:1798523503951488:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715208116.852291:0:21507:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852298:0:21507:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852304:0:21507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852309:0:21507:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852316:0:21507:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852322:0:21507:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae74fc0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715208116.852326:0:21507:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852332:0:21507:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852348:0:21507:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852354:0:21507:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208116.852359:0:21507:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21507 initiator: MDT0 00010000:00010000:3.0:1715208116.852365:0:21507:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74fc0/0xbbeffb005ec3e869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21507 initiator: MDT0 00000080:00020000:3.0:1715208116.852385:0:21507:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715208116.852403:0:21507:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208116.852407:0:21507:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208116.852414:0:21507:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208116.852421:0:21507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.852428:0:21507:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208116.852436:0:21507:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208116.852438:0:21507:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208116.852442:0:21507:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff8800aa3c3cc8 00010000:00010000:3.0:1715208116.852445:0:21507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.852452:0:21507:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208116.852535:0:21507:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208116.852547:0:21507:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208116.852554:0:21507:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.852562:0:21507:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208116.852570:0:21507:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208116.852572:0:21507:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208116.852576:0:21507:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff8800aa3c3b80 00010000:00010000:3.0:1715208116.852579:0:21507:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.852585:0:21507:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208116.852594:0:21507:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715208116.852599:0:21507:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715208116.853475:0:21508:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208116.853491:0:21508:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.853502:0:21508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.853515:0:21508:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208116.853525:0:21508:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208116.853528:0:21508:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:1.0:1715208116.853533:0:21508:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012b893b80 00010000:00010000:1.0:1715208116.853537:0:21508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.853545:0:21508:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208116.853556:0:21508:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715208116.853562:0:21508:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715208116.853588:0:21508:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208116.853594:0:21508:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.853599:0:21508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.853607:0:21508:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208116.853626:0:21508:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208116.853629:0:21508:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:1.0:1715208116.853633:0:21508:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012b893bb0 00010000:00010000:1.0:1715208116.853636:0:21508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.853643:0:21508:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208116.853651:0:21508:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208116.853657:0:21508:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:1.0:1715208116.853662:0:21508:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff88012e4b90c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208116.853669:0:21508:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), file ffff8800b6ded200, open_flags 8000, mode 0 opened 0 00000080:00200000:1.0:1715208116.853676:0:21508:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), intent=open 00000002:00010000:1.0:1715208116.853686:0:21508:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:1.0:1715208116.853719:0:21508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 21508 initiator: MDT0 00010000:00010000:1.0:1715208116.853726:0:21508:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21508 initiator: MDT0 00000020:00100000:1.0:1715208116.853736:0:21508:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715208116.853746:0:21508:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a615500 x1798523503951616/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715208116.853756:0:21508:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21508 initiator: MDT0 00000100:00100000:1.0:1715208116.853772:0:21508:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a615500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21508:1798523503951616:192.168.202.138@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1715208116.853902:0:21508:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87240 going to sleep for 11 seconds 00000100:00100000:2.0:1715208116.856485:0:21508:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967504 gen 1 00000100:00100000:2.0:1715208116.856500:0:21508:0:(client.c:3000:ptlrpc_free_committed()) @@@ stopping search req@ffff88012a615500 x1798523503951616/t4294967505(4294967505) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208132 ref 3 fl Rpc:RPQU/204/0 rc 0/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000100:00100000:2.0:1715208116.856519:0:21508:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21508:1798523503951616:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715208116.856536:0:21508:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856551:0:21508:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856561:0:21508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856572:0:21508:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856582:0:21508:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856590:0:21508:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bafcc0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715208116.856595:0:21508:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856604:0:21508:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856614:0:21508:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856622:0:21508:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715208116.856637:0:21508:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21508 initiator: MDT0 00010000:00010000:2.0:1715208116.856645:0:21508:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bafcc0/0xbbeffb005ec3e870 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21508 initiator: MDT0 00000002:00100000:2.0:1715208116.856666:0:21508:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012a615500 x1798523503951616/t4294967505(4294967505) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208132 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715208116.856683:0:21508:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a615500 x1798523503951616/t4294967505(4294967505) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208132 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208116.856714:0:21508:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 10752 00000080:00200000:2.0:1715208116.856720:0:21508:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b08900c8): rc = 0 00000080:00010000:2.0:1715208116.856726:0:21508:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b08900c8) for lock 0x0 00000080:00200008:2.0:1715208116.856746:0:21508:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715208116.856767:0:21508:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a615500 x1798523503951616/t4294967505(4294967505) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208132 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208116.856834:0:21508:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b08900c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715208116.856907:0:21508:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=1cb80f0 00800000:00000080:2.0:1715208116.856920:0:21508:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa275580 uarg=0000000000000000 00000002:00000080:2.0:1715208116.856934:0:21508:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa275580 uarg=0000000000000000 00000100:00100000:2.0:1715208116.856968:0:21508:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21508:1798523503951680:192.168.202.138@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715208116.857096:0:21508:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1715208116.858820:0:21508:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:21508:1798523503951680:192.168.202.138@tcp:59:lhsmtool_posix.0 00000080:00200000:1.0:1715208116.863011:0:21509:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715208116.863026:0:21509:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.863081:0:21509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863091:0:21509:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863099:0:21509:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00000100:00100000:1.0:1715208116.863110:0:21509:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87d80 going to sleep for 0 seconds 00000100:00100000:1.0:1715208116.863118:0:21509:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21509:1798523503951744:192.168.202.138@tcp:101:lfs.0 00010000:00010000:1.0:1715208116.863127:0:21509:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863133:0:21509:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863139:0:21509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863146:0:21509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863152:0:21509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863157:0:21509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bad440 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208116.863160:0:21509:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863177:0:21509:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863184:0:21509:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863189:0:21509:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208116.863193:0:21509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863199:0:21509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bad440/0xbbeffb005ec3e877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21509 initiator: MDT0 00000080:00020000:1.0:1715208116.863217:0:21509:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715208116.863243:0:21509:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715208116.863251:0:21509:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.863269:0:21509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863276:0:21509:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863282:0:21509:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00000100:00100000:1.0:1715208116.863291:0:21509:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87d80 going to sleep for 0 seconds 00000100:00100000:1.0:1715208116.863297:0:21509:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21509:1798523503951808:192.168.202.138@tcp:101:lfs.0 00010000:00010000:1.0:1715208116.863304:0:21509:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863310:0:21509:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863325:0:21509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863331:0:21509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863337:0:21509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863342:0:21509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bae400 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208116.863345:0:21509:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863350:0:21509:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863356:0:21509:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863361:0:21509:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208116.863364:0:21509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863369:0:21509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae400/0xbbeffb005ec3e87e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21509 initiator: MDT0 00000080:00020000:1.0:1715208116.863384:0:21509:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715208116.863400:0:21509:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715208116.863405:0:21509:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715208116.863411:0:21509:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.863426:0:21509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863438:0:21509:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863446:0:21509:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00000100:00100000:1.0:1715208116.863454:0:21509:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87d80 going to sleep for 0 seconds 00000100:00100000:1.0:1715208116.863459:0:21509:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21509:1798523503951872:192.168.202.138@tcp:101:lfs.0 00010000:00010000:1.0:1715208116.863465:0:21509:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863470:0:21509:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863476:0:21509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863482:0:21509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863487:0:21509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863492:0:21509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bae640 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208116.863495:0:21509:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863500:0:21509:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863505:0:21509:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863518:0:21509:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208116.863522:0:21509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21509 initiator: MDT0 00010000:00010000:1.0:1715208116.863528:0:21509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bae640/0xbbeffb005ec3e885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21509 initiator: MDT0 00000080:00020000:1.0:1715208116.863541:0:21509:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715208116.866755:0:21510:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715208116.866771:0:21510:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.866799:0:21510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866808:0:21510:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866816:0:21510:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21510 initiator: MDT0 00000100:00100000:1.0:1715208116.866827:0:21510:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87d80 going to sleep for 0 seconds 00000100:00100000:1.0:1715208116.866835:0:21510:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job bash:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:21510:1798523503951936:192.168.202.138@tcp:101:bash.0 00010000:00010000:1.0:1715208116.866844:0:21510:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866850:0:21510:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866856:0:21510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866863:0:21510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866875:0:21510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866881:0:21510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bacfc0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208116.866884:0:21510:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866889:0:21510:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866895:0:21510:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866901:0:21510:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208116.866905:0:21510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21510 initiator: MDT0 00010000:00010000:1.0:1715208116.866910:0:21510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacfc0/0xbbeffb005ec3e88c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 21510 initiator: MDT0 00000080:00020000:1.0:1715208116.866928:0:21510:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715208116.869748:0:21511:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208116.869762:0:21511:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.869773:0:21511:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.869784:0:21511:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208116.869794:0:21511:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208116.869797:0:21511:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:1.0:1715208116.869807:0:21511:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012d463af8 00010000:00010000:1.0:1715208116.869811:0:21511:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.869819:0:21511:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208116.869830:0:21511:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208116.869839:0:21511:0:(namei.c:1106:ll_lookup_nd()) VFS Op:name=d25b.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff880136f588c8), flags=16 00000080:00200000:1.0:1715208116.869843:0:21511:0:(namei.c:838:ll_lookup_it()) VFS Op:name=d25b.sanity-hsm, dir=[0x200000007:0x1:0x0](ffff880136f588c8), intent=0 00000002:00010000:1.0:1715208116.869850:0:21511:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: d25b.sanity-hsm,[0x0:0x0:0x0]) in obj [0x200000007:0x1:0x0], intent: lookup flags 0 00010000:00010000:1.0:1715208116.869872:0:21511:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.869879:0:21511:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.869886:0:21511:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21511 initiator: MDT0 00000100:00100000:1.0:1715208116.869901:0:21511:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job rm:cbae74da-7571-45ad-b971-0e0378bbd4e4:21511:1798523503952000:192.168.202.138@tcp:101:rm.0 00000100:00100000:1.0:1715208116.869954:0:21511:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87d80 going to sleep for 11 seconds 00000100:00100000:1.0:1715208116.872032:0:21511:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a617800 pname:cluuid:pid:xid:nid:opc:job rm:cbae74da-7571-45ad-b971-0e0378bbd4e4:21511:1798523503952000:192.168.202.138@tcp:101:rm.0 00010000:00010000:1.0:1715208116.872074:0:21511:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872085:0:21511:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872092:0:21511:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872108:0:21511:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872114:0:21511:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872120:0:21511:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136baeac0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208116.872123:0:21511:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872129:0:21511:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872135:0:21511:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872141:0:21511:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208116.872145:0:21511:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21511 initiator: MDT0 00010000:00010000:1.0:1715208116.872151:0:21511:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baeac0/0xbbeffb005ec3e893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 21511 initiator: MDT0 00000002:00100000:1.0:1715208116.872166:0:21511:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=10 disposition=7, status=0 req@ffff88012a617800 x1798523503952000/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 584/584 e 0 to 0 dl 1715208132 ref 1 fl Complete:RQU/200/0 rc 301/301 job:'rm.0' uid:0 gid:0 00010000:00010000:1.0:1715208116.872190:0:21511:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.872201:0:21511:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208116.872208:0:21511:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012d463930 00010000:00010000:1.0:1715208116.872216:0:21511:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.872225:0:21511:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208116.872293:0:21511:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208116.872303:0:21511:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208116.872310:0:21511:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.872319:0:21511:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208116.872326:0:21511:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208116.872329:0:21511:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:1.0:1715208116.872334:0:21511:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012d463b90 00010000:00010000:1.0:1715208116.872336:0:21511:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208116.872344:0:21511:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208116.872352:0:21511:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208116.872357:0:21511:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d25b.sanity-hsm, flags=16 00000080:00200000:3.0:1715208116.876839:0:21512:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208116.876854:0:21512:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208116.876865:0:21512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.876877:0:21512:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208116.876888:0:21512:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208116.876891:0:21512:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208116.876896:0:21512:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88013034baf8 00010000:00010000:3.0:1715208116.876905:0:21512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.876913:0:21512:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208116.876924:0:21512:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208116.876929:0:21512:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d25b.sanity-hsm, flags=17 00000080:00200000:3.0:1715208116.876956:0:21512:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208116.876963:0:21512:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208116.876969:0:21512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.876977:0:21512:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208116.877010:0:21512:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208116.877013:0:21512:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208116.877017:0:21512:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88013034baf8 00010000:00010000:3.0:1715208116.877020:0:21512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.877027:0:21512:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208116.877035:0:21512:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208116.877039:0:21512:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d25b.sanity-hsm, flags=17 00000080:00200000:3.0:1715208116.877099:0:21512:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208116.877106:0:21512:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208116.877113:0:21512:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.877128:0:21512:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208116.877137:0:21512:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208116.877139:0:21512:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208116.877143:0:21512:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88013034bbb0 00010000:00010000:3.0:1715208116.877146:0:21512:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208116.877154:0:21512:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208116.877163:0:21512:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:3.0:1715208116.877167:0:21512:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=d25b.sanity-hsm, flags=17 00000100:00080000:2.0:1715208117.196200:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208117.196208:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208117.196219:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208117.196222:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208117.196250:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208117.196253:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715208117.196276:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503952128:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208117.196291:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503952064:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208117.197796:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523503952064:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715208117.197825:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503952128:192.168.202.138@tcp:400:kworker.0 00000001:02000400:3.0:1715208117.366529:0:21644:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_25b: @@@@@@ FAIL: cannot create /mnt/lustre2/d25b.sanity-hsm/f25b.sanity-hsm with cp, status=1 00010000:00010000:1.0:1715208117.402186:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 321 lines, 321 kept, 0 dropped, 0 bad.