00000080:00200080:3.0F:1715210008.915223:0:12546:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=8000f0 00800000:00000080:3.0:1715210008.915247:0:12546:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa14cd80 uarg=0000000000000000 00000002:00000080:3.0:1715210008.915255:0:12546:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800aa14cd80 uarg=0000000000000000 00000100:00100000:3.0:1715210008.915301:0:12546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8a80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:12546:1798523504037696:192.168.202.138@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715210008.915383:0:12546:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87000 going to sleep for 11 seconds 00000100:00100000:3.0:1715210008.916987:0:12546:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8a80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:12546:1798523504037696:192.168.202.138@tcp:60:lhsmtool_posix.0 00000080:00200008:3.0:1715210008.917026:0:12546:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:3.0:1715210008.917085:0:12546:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012a614e00 x1798523504027584/t4294967540(4294967540) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209819 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:3.0:1715210008.917108:0:12546:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1715210008.917113:0:12546:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800aafd8a80 x1798523504037824/t0(0) o35->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715210008.917128:0:12546:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8a80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:12546:1798523504037824:192.168.202.138@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715210008.917158:0:12546:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87000 going to sleep for 11 seconds 00000100:00100000:3.0:1715210008.919287:0:12546:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8a80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:12546:1798523504037824:192.168.202.138@tcp:35:lhsmtool_posix.0 00000002:00100000:3.0:1715210008.919309:0:12546:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012a614e00 x1798523504027584/t4294967540(4294967540) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209819 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:3.0:1715210008.919350:0:12546:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200008:3.0:1715210008.923221:0:12546:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00010000:00010000:1.0F:1715210009.178285:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1715210010.180164:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0F:1715210010.220115:0:30635:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715210010.220122:0:30635:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715210010.220124:0:30635:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715210010.220125:0:30635:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715210010.220135:0:30635:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715210010.220137:0:30635:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715210010.220150:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523504037888:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210010.220153:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504037952:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210010.220209:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038016:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210010.221082:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523504037888:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210010.221092:0:1957:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967548 gen 1 00000100:00100000:2.0:1715210010.221097:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504037952:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210010.221099:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038016:192.168.202.138@tcp:400:kworker.0 00010000:00010000:2.0:1715210011.182307:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715210012.184276:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715210013.186292:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715210013.896731:0:15762:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 19:13:33 (1715210013) 00010000:00010000:3.0:1715210014.188288:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715210014.434404:0:15913:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_29d Need 3 or more clients, have 1 00010000:00010000:1.0:1715210015.190216:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715210015.228265:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210015.228272:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715210015.228274:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210015.228277:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715210015.228291:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210015.228294:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715210015.228321:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038144:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210015.228361:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523504038080:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210015.228408:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504038208:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210015.230031:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504038208:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210015.230037:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038144:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210015.230099:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523504038080:192.168.202.138@tcp:400:kworker.0 00010000:00010000:0.0:1715210016.192286:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715210017.129607:0:16188:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 30a: Restore at exec (import case) ==== 19:13:36 (1715210016) 00010000:00010000:3.0:1715210017.194207:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715210017.668953:0:16338:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_30a Need 2 or more clients, have 1 00010000:00010000:0.0:1715210018.196228:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715210019.198260:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715210020.200209:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715210020.236154:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210020.236161:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715210020.236165:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210020.236168:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715210020.236183:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210020.236195:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715210020.236224:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523504038272:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210020.236232:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504038336:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210020.236312:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038400:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210020.237911:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504038336:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210020.237952:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523504038272:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210020.237969:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038400:192.168.202.138@tcp:400:kworker.0 00000001:02000400:1.0:1715210020.482705:0:16614:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 30b: Restore at exec (release case) === 19:13:39 (1715210019) 00000001:02000400:3.0:1715210021.011849:0:16764:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_30b Need 2 or more clients, have 1 00010000:00010000:0.0:1715210021.202271:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715210022.204241:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715210023.206218:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715210023.741499:0:17039:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 19:13:43 (1715210023) 00010000:00010000:1.0:1715210024.208277:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715210024.263561:0:17190:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_30c Need 2 or more clients, have 1 00010000:00010000:0.0:1715210025.210265:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1715210025.244161:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210025.244168:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715210025.244172:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210025.244175:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715210025.244191:0:5:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715210025.244195:0:5:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715210025.244223:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038528:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210025.244257:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523504038464:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210025.244316:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504038592:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715210025.246107:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523504038528:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210025.246114:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1957:1798523504038464:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715210025.246130:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523504038592:192.168.202.138@tcp:400:kworker.0 00010000:00010000:3.0:1715210026.212253:0:3699:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715210026.986578:0:17465:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 19:13:46 (1715210026) 00000080:00200008:1.0:1715210027.119289:0:17508:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715210027.119300:0:17508:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715210027.119321:0:17508:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715210027.119339:0:17508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715210027.119355:0:17508:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715210027.119367:0:17508:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715210027.119371:0:17508:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3eb17 00000080:00010000:1.0:1715210027.119433:0:17508:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3eb17 from it ffff8800b6397cc8 00010000:00010000:1.0:1715210027.119439:0:17508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715210027.119467:0:17508:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00200008:1.0:1715210027.119974:0:17508:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715210027.119984:0:17508:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715210027.119997:0:17508:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715210027.120075:0:17508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120084:0:17508:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120094:0:17508:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17508 initiator: MDT0 00000100:00100000:1.0:1715210027.120113:0:17508:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa29a480 going to sleep for 0 seconds 00000100:00100000:1.0:1715210027.120125:0:17508:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a616a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:17508:1798523504038656:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715210027.120137:0:17508:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120144:0:17508:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120150:0:17508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120156:0:17508:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120163:0:17508:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120169:0:17508:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff88012dc24000 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715210027.120174:0:17508:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120180:0:17508:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120194:0:17508:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120200:0:17508:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715210027.120205:0:17508:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17508 initiator: MDT0 00010000:00010000:1.0:1715210027.120211:0:17508:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff88012dc24000/0xbbeffb005ec3eb79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17508 initiator: MDT0 00000080:00020000:1.0:1715210027.120233:0:17508:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715210027.130641:0:17508:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715210027.130650:0:17508:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715210027.130662:0:17508:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715210027.130673:0:17508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715210027.130685:0:17508:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715210027.130695:0:17508:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715210027.130698:0:17508:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3eb17 00000080:00010000:1.0:1715210027.130703:0:17508:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3eb17 from it ffff8800b6397cc8 00010000:00010000:1.0:1715210027.130707:0:17508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715210027.130715:0:17508:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715210027.130819:0:17508:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:1.0:1715210027.130833:0:17508:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715210027.130841:0:17508:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715210027.130849:0:17508:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00010000:1.0:1715210027.130857:0:17508:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:1.0:1715210027.130860:0:17508:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3eb17 00000080:00010000:1.0:1715210027.130864:0:17508:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3eb17 from it ffff8800b6397b80 00010000:00010000:1.0:1715210027.130867:0:17508:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715210027.130874:0:17508:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00200000:1.0:1715210027.130883:0:17508:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:1.0:1715210027.130890:0:17508:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:0.0:1715210027.131684:0:17509:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:0.0:1715210027.131700:0:17509:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715210027.131711:0:17509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715210027.131724:0:17509:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1715210027.131734:0:17509:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:0.0:1715210027.131738:0:17509:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3eb17 00000080:00010000:0.0:1715210027.131743:0:17509:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3eb17 from it ffff8800aa12fb80 00010000:00010000:0.0:1715210027.131747:0:17509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715210027.131755:0:17509:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1715210027.131765:0:17509:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 44 00000080:00200008:0.0:1715210027.131771:0:17509:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200000:0.0:1715210027.131797:0:17509:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8),name=/ 00000002:00010000:0.0:1715210027.131803:0:17509:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715210027.131808:0:17509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715210027.131833:0:17509:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00010000:0.0:1715210027.131846:0:17509:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) 00000080:00010000:0.0:1715210027.131850:0:17509:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff880136f588c8) for lock 0xbbeffb005ec3eb17 00000080:00010000:0.0:1715210027.131856:0:17509:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0xbbeffb005ec3eb17 from it ffff8800aa12fbb0 00010000:00010000:0.0:1715210027.131861:0:17509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715210027.131873:0:17509:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff880136bad680/0xbbeffb005ec3eb17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x8c55e4ad37f67497 expref: -99 pid: 12552 timeout: 0 lvb_type: 0 00000080:00200000:0.0:1715210027.131888:0:17509:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8), inode mode 41ed mask 1 00000080:00200000:0.0:1715210027.131897:0:17509:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:0.0:1715210027.131902:0:17509:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff88012e4b90c8), inode mode 41ed mask 1 00000080:00200000:0.0:1715210027.131910:0:17509:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), file ffff88012aa88780, open_flags 8000, mode 0 opened 0 00000080:00200000:0.0:1715210027.131916:0:17509:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff88012e4b90c8), intent=open 00000002:00010000:0.0:1715210027.131927:0:17509:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:0.0:1715210027.132096:0:17509:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 17509 initiator: MDT0 00010000:00010000:0.0:1715210027.132105:0:17509:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 17509 initiator: MDT0 00000020:00100000:0.0:1715210027.132116:0:17509:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:0.0:1715210027.132126:0:17509:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012aaf4380 x1798523504038784/t0(0) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:0.0:1715210027.132136:0:17509:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 17509 initiator: MDT0 00000100:00100000:0.0:1715210027.132213:0:17509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012aaf4380 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:17509:1798523504038784:192.168.202.138@tcp:101:lhsmtool_posix.0 00000100:00100000:0.0:1715210027.132339:0:17509:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeeeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1715210027.134696:0:17509:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf4380 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:17509:1798523504038784:192.168.202.138@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1715210027.134712:0:17509:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134723:0:17509:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134729:0:17509:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134736:0:17509:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134754:0:17509:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134760:0:17509:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800ac2bdf80 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715210027.134763:0:17509:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134769:0:17509:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134775:0:17509:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134780:0:17509:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715210027.134784:0:17509:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 17509 initiator: MDT0 00010000:00010000:1.0:1715210027.134790:0:17509:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800aa1c9800 lock: ffff8800ac2bdf80/0xbbeffb005ec3eb80 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 17509 initiator: MDT0 00000002:00100000:1.0:1715210027.134804:0:17509:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff88012aaf4380 x1798523504038784/t4294967549(4294967549) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715210043 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:1.0:1715210027.134818:0:17509:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012aaf4380 x1798523504038784/t4294967549(4294967549) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715210043 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:1.0:1715210027.134843:0:17509:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 10752 00000080:00200000:1.0:1715210027.134847:0:17509:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b08900c8): rc = 0 00000080:00010000:1.0:1715210027.134852:0:17509:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b08900c8) for lock 0x0 00000080:00200008:1.0:1715210027.134866:0:17509:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:1.0:1715210027.134879:0:17509:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff88012aaf4380 x1798523504038784/t4294967549(4294967549) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715210043 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:1.0:1715210027.134945:0:17509:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b08900c8), inode mode 4040 mask 44 00000080:00200080:1.0:1715210027.135001:0:17509:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=1fdd0f0 00800000:00000080:1.0:1715210027.135012:0:17509:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800a9412900 uarg=0000000000000000 00000002:00000080:1.0:1715210027.135022:0:17509:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800a9412900 uarg=0000000000000000 00000100:00100000:1.0:1715210027.135083:0:17509:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a616a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:17509:1798523504038848:192.168.202.138@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1715210027.135135:0:17509:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa29ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1715210027.136665:0:17509:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a616a00 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:17509:1798523504038848:192.168.202.138@tcp:59:lhsmtool_posix.0 00000080:00200000:2.0:1715210027.141214:0:17510:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715210027.141229:0:17510:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715210027.141258:0:17510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141267:0:17510:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141275:0:17510:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00000100:00100000:2.0:1715210027.141286:0:17510:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aafaf9c0 going to sleep for 0 seconds 00000100:00100000:2.0:1715210027.141294:0:17510:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:17510:1798523504038912:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715210027.141303:0:17510:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141309:0:17510:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141316:0:17510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141322:0:17510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141328:0:17510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141343:0:17510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa308900 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715210027.141347:0:17510:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141353:0:17510:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141359:0:17510:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141365:0:17510:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715210027.141369:0:17510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141374:0:17510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa308900/0xbbeffb005ec3eb87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17510 initiator: MDT0 00000080:00020000:2.0:1715210027.141392:0:17510:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:2.0:1715210027.141416:0:17510:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715210027.141424:0:17510:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715210027.141442:0:17510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141472:0:17510:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141479:0:17510:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00000100:00100000:2.0:1715210027.141488:0:17510:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aafaf9c0 going to sleep for 0 seconds 00000100:00100000:2.0:1715210027.141494:0:17510:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:17510:1798523504038976:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715210027.141501:0:17510:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141513:0:17510:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141519:0:17510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141524:0:17510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141530:0:17510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141535:0:17510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa30a1c0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715210027.141539:0:17510:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141544:0:17510:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141550:0:17510:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141555:0:17510:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715210027.141558:0:17510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141564:0:17510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3eb8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17510 initiator: MDT0 00000080:00020000:2.0:1715210027.141580:0:17510:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715210027.141598:0:17510:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715210027.141602:0:17510:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715210027.141614:0:17510:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715210027.141632:0:17510:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141638:0:17510:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141645:0:17510:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00000100:00100000:2.0:1715210027.141653:0:17510:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aafaf9c0 going to sleep for 0 seconds 00000100:00100000:2.0:1715210027.141658:0:17510:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6325c00 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:17510:1798523504039040:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715210027.141664:0:17510:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141670:0:17510:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141675:0:17510:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141681:0:17510:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141687:0:17510:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141692:0:17510:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa3086c0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715210027.141694:0:17510:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141700:0:17510:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141714:0:17510:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141719:0:17510:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715210027.141722:0:17510:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17510 initiator: MDT0 00010000:00010000:2.0:1715210027.141728:0:17510:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa3086c0/0xbbeffb005ec3eb95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17510 initiator: MDT0 00000080:00020000:2.0:1715210027.141741:0:17510:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715210027.214217:0:3698:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:3.0:1715210027.598416:0:17546:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:3.0:1715210027.598432:0:17546:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715210027.598484:0:17546:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598490:0:17546:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598501:0:17546:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17546 initiator: MDT0 00000100:00100000:3.0:1715210027.598513:0:17546:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aad87540 going to sleep for 0 seconds 00000100:00100000:3.0:1715210027.598520:0:17546:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafd8000 pname:cluuid:pid:xid:nid:opc:job mkdir:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:17546:1798523504039104:192.168.202.138@tcp:101:mkdir.0 00010000:00010000:3.0:1715210027.598527:0:17546:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598531:0:17546:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598535:0:17546:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598539:0:17546:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598543:0:17546:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598547:0:17546:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aae75b00 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:3.0:1715210027.598549:0:17546:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598553:0:17546:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598557:0:17546:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598560:0:17546:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715210027.598563:0:17546:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17546 initiator: MDT0 00010000:00010000:3.0:1715210027.598569:0:17546:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aae75b00/0xbbeffb005ec3eb9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 17546 initiator: MDT0 00000080:00020000:3.0:1715210027.598583:0:17546:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000001:02000400:3.0:1715210027.958993:0:17678:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_31a: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d31a.sanity-hsm' 00010000:00010000:0.0:1715210028.216190:0:3697:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 288 lines, 288 kept, 0 dropped, 0 bad.