00010000:00010000:0.0F:1715208105.378246:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:2.0F:1715208105.626829:0:19186:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=13720f0 00800000:00000080:2.0:1715208105.626852:0:19186:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aaf56ba0 uarg=0000000000000000 00000002:00000080:2.0:1715208105.626858:0:19186:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aaf56ba0 uarg=0000000000000000 00000100:00100000:2.0:1715208105.626901:0:19186:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6327800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:19186:1798523503950400:192.168.202.138@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715208105.626972:0:19186:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1715208105.628611:0:19186:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967501 gen 1 00000100:00100000:2.0:1715208105.628624:0:19186:0:(client.c:3005:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff88012a617100 x1798523503949440/t4294967501(4294967501) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208117 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000100:00100000:2.0:1715208105.628639:0:19186:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:19186:1798523503950400:192.168.202.138@tcp:60:lhsmtool_posix.0 00000080:00200008:2.0:1715208105.628684:0:19186:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715208105.628716:0:19186:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012a617100 x1798523503949440/t4294967501(4294967501) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208117 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:2.0:1715208105.628739:0:19186:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:2.0:1715208105.628745:0:19186:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800b6327800 x1798523503950528/t0(0) o35->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1715208105.628757:0:19186:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6327800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:19186:1798523503950528:192.168.202.138@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1715208105.628794:0:19186:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0900 going to sleep for 11 seconds 00000100:00100000:3.0F:1715208105.630438:0:19186:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327800 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:19186:1798523503950528:192.168.202.138@tcp:35:lhsmtool_posix.0 00000002:00100000:3.0:1715208105.630467:0:19186:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012a617100 x1798523503949440/t4294967501(4294967501) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208117 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:3.0:1715208105.630508:0:19186:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200008:0.0:1715208105.633353:0:19186:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00010000:00010000:0.0:1715208106.380285:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1715208107.180207:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208107.180215:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715208107.180217:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208107.180220:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715208107.180232:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503950592:192.168.202.138@tcp:400:kworker.0 00000100:00080000:2.0:1715208107.180236:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715208107.180239:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715208107.180271:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503950656:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208107.180336:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503950720:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715208107.181981:0:1957:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967502 gen 1 00000100:00100000:2.0:1715208107.181997:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503950656:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208107.182095:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503950720:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715208107.182111:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503950592:192.168.202.138@tcp:400:kworker.0 00010000:00010000:1.0F:1715208107.382240:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715208108.384311:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715208109.386203:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715208110.137673:0:20523:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 25a: Restore lost file (HS_LOST flag) from import ========================================================== 18:41:49 (1715208109) 00000080:00200008:3.0:1715208110.206280:0:20566:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208110.206287:0:20566:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208110.206300:0:20566:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208110.206313:0:20566:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208110.206323:0:20566:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208110.206330:0:20566:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208110.206332:0:20566:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208110.206353:0:20566:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012da4fcc8 00010000:00010000:3.0:1715208110.206356:0:20566:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208110.206361:0:20566:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715208110.206619:0:20566:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208110.206623:0:20566:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715208110.206630:0:20566:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208110.206660:0:20566:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206665:0:20566:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206671:0:20566:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20566 initiator: MDT0 00000100:00100000:3.0:1715208110.206682:0:20566:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1a3900 going to sleep for 0 seconds 00000100:00100000:3.0:1715208110.206689:0:20566:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:20566:1798523503950784:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715208110.206696:0:20566:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206700:0:20566:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206703:0:20566:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206706:0:20566:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206709:0:20566:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206713:0:20566:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae74d80 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715208110.206715:0:20566:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206722:0:20566:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206726:0:20566:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206729:0:20566:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715208110.206733:0:20566:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20566 initiator: MDT0 00010000:00010000:3.0:1715208110.206736:0:20566:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae74d80/0xbbeffb005ec3e84d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20566 initiator: MDT0 00000080:00020000:3.0:1715208110.206747:0:20566:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715208110.206756:0:20566:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715208110.206759:0:20566:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208110.206762:0:20566:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208110.206766:0:20566:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208110.206770:0:20566:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208110.206774:0:20566:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208110.206775:0:20566:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208110.206778:0:20566:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012da4fcc8 00010000:00010000:3.0:1715208110.206779:0:20566:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208110.206783:0:20566:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208110.206828:0:20566:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:3.0:1715208110.206833:0:20566:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715208110.206836:0:20566:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208110.206841:0:20566:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715208110.206845:0:20566:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:3.0:1715208110.206847:0:20566:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:3.0:1715208110.206848:0:20566:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012da4fb80 00010000:00010000:3.0:1715208110.206850:0:20566:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715208110.206853:0:20566:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715208110.206858:0:20566:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715208110.206862:0:20566:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715208110.207293:0:20567:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208110.207301:0:20567:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208110.207307:0:20567:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208110.207314:0:20567:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208110.207336:0:20567:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208110.207339:0:20567:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:1.0:1715208110.207344:0:20567:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012b623b80 00010000:00010000:1.0:1715208110.207347:0:20567:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208110.207354:0:20567:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208110.207364:0:20567:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715208110.207369:0:20567:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:1.0:1715208110.207391:0:20567:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715208110.207396:0:20567:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208110.207401:0:20567:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208110.207407:0:20567:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715208110.207413:0:20567:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715208110.207421:0:20567:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3e789 00000080:00010000:1.0:1715208110.207425:0:20567:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3e789 from it ffff88012b623bb0 00010000:00010000:1.0:1715208110.207428:0:20567:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715208110.207434:0:20567:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136badf80/0xbbeffb005ec3e789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f66f81 expref: -99 pid: 16454 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715208110.207441:0:20567:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208110.207446:0:20567:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:1.0:1715208110.207450:0:20567:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff88012e4b90c8), inode mode 41ed mask 1 00000080:00200000:1.0:1715208110.207457:0:20567:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), file ffff8800b5ff8180, open_flags 8000, mode 0 opened 0 00000080:00200000:1.0:1715208110.207463:0:20567:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), intent=open 00000002:00010000:1.0:1715208110.207472:0:20567:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:1.0:1715208110.207503:0:20567:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 20567 initiator: MDT0 00010000:00010000:1.0:1715208110.207510:0:20567:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20567 initiator: MDT0 00000020:00100000:1.0:1715208110.207519:0:20567:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:1.0:1715208110.207528:0:20567:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a616680 x1798523503950912/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1715208110.207538:0:20567:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20567 initiator: MDT0 00000100:00100000:1.0:1715208110.207551:0:20567:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a616680 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503950912:192.168.202.138@tcp:101:lhsmtool_posix.0 00000100:00100000:1.0:1715208110.207692:0:20567:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715208110.211359:0:20567:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a616680 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503950912:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1715208110.211367:0:20567:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211373:0:20567:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211377:0:20567:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211380:0:20567:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211383:0:20567:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211386:0:20567:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136baf600 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715208110.211388:0:20567:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211391:0:20567:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211394:0:20567:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211397:0:20567:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715208110.211403:0:20567:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 20567 initiator: MDT0 00010000:00010000:2.0:1715208110.211407:0:20567:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136baf600/0xbbeffb005ec3e854 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 20567 initiator: MDT0 00000002:00100000:2.0:1715208110.211415:0:20567:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012a616680 x1798523503950912/t4294967503(4294967503) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208126 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:2.0:1715208110.211423:0:20567:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a616680 x1798523503950912/t4294967503(4294967503) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208126 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208110.211455:0:20567:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 10752 00000080:00200000:2.0:1715208110.211457:0:20567:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b08900c8): rc = 0 00000080:00010000:2.0:1715208110.211460:0:20567:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b08900c8) for lock 0x0 00000080:00200008:2.0:1715208110.211468:0:20567:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:2.0:1715208110.211476:0:20567:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012a616680 x1798523503950912/t4294967503(4294967503) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715208126 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:2.0:1715208110.211505:0:20567:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b08900c8), inode mode 4040 mask 44 00000080:00200080:2.0:1715208110.211535:0:20567:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=a8e0f0 00800000:00000080:2.0:1715208110.211541:0:20567:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aaf562a0 uarg=0000000000000000 00000002:00000080:2.0:1715208110.211548:0:20567:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aaf562a0 uarg=0000000000000000 00000100:00100000:2.0:1715208110.211563:0:20567:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503950976:192.168.202.138@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1715208110.211592:0:20567:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012c0e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1715208110.212273:0:20567:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6326d80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:20567:1798523503950976:192.168.202.138@tcp:59:lhsmtool_posix.0 00000080:00200000:1.0:1715208110.212383:0:20568:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715208110.212393:0:20568:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715208110.212410:0:20568:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212415:0:20568:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212420:0:20568:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20568 initiator: MDT0 00000100:00100000:1.0:1715208110.212426:0:20568:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad870c0 going to sleep for 0 seconds 00000100:00100000:1.0:1715208110.212430:0:20568:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615500 pname:cluuid:pid:xid:nid:opc:job mkdir:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:20568:1798523503951040:192.168.202.138@tcp:101:mkdir.0 00010000:00010000:1.0:1715208110.212435:0:20568:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212438:0:20568:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212441:0:20568:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212445:0:20568:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212448:0:20568:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212450:0:20568:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136baed00 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715208110.212452:0:20568:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212455:0:20568:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212464:0:20568:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212468:0:20568:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715208110.212470:0:20568:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20568 initiator: MDT0 00010000:00010000:1.0:1715208110.212473:0:20568:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136baed00/0xbbeffb005ec3e85b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20568 initiator: MDT0 00000080:00020000:1.0:1715208110.212482:0:20568:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715208110.287478:0:20605:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:0.0:1715208110.287493:0:20605:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715208110.287526:0:20605:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287531:0:20605:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287537:0:20605:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20605 initiator: MDT0 00000100:00100000:0.0:1715208110.287548:0:20605:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeeee40 going to sleep for 0 seconds 00000100:00100000:0.0:1715208110.287555:0:20605:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf4700 pname:cluuid:pid:xid:nid:opc:job mkdir:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:20605:1798523503951104:192.168.202.138@tcp:101:mkdir.0 00010000:00010000:0.0:1715208110.287562:0:20605:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287566:0:20605:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287569:0:20605:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287573:0:20605:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287577:0:20605:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287580:0:20605:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac2bed00 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:0.0:1715208110.287582:0:20605:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287591:0:20605:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287596:0:20605:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287599:0:20605:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715208110.287602:0:20605:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20605 initiator: MDT0 00010000:00010000:0.0:1715208110.287605:0:20605:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800ac2bed00/0xbbeffb005ec3e862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 20605 initiator: MDT0 00000080:00020000:0.0:1715208110.287616:0:20605:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715208110.388133:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715208110.684002:0:20737:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_25a: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d25a.sanity-hsm' Debug log: 191 lines, 191 kept, 0 dropped, 0 bad.