00010000:00010000:2.0F:1715206647.460163:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0F:1715206647.756154:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206647.756172:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:3.0:1715206647.756174:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206647.756177:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) 46af332d-2ee7-4d47-b762-82c1eb2b6bbd->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715206647.756195:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503848768:192.168.202.138@tcp:400:kworker.0 00000100:00080000:3.0:1715206647.756197:0:65:0:(pinger.c:253:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1715206647.756199:0:65:0:(pinger.c:271:ptlrpc_pinger_process_import()) cbae74da-7571-45ad-b971-0e0378bbd4e4->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715206647.756221:0:1957:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503848832:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206647.756263:0:1956:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800aafdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503848896:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206647.757355:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:cbae74da-7571-45ad-b971-0e0378bbd4e4:1956:1798523503848896:192.168.202.138@tcp:400:kworker.0 00000100:00100000:2.0:1715206647.757365:0:1956:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ff645b43-0d7b-4a37-b9cc-6ac8f8d65c0d:1956:1798523503848768:192.168.202.138@tcp:400:kworker.0 00000100:00100000:3.0:1715206647.757375:0:1957:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800aa1c9800: committing for last_committed 4294967405 gen 1 00000100:00100000:3.0:1715206647.757384:0:1957:0:(client.c:3005:ptlrpc_free_committed()) @@@ keeping (FL_REPLAY) req@ffff88012a616a00 x1798523503848256/t4294967405(4294967405) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206795 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000100:00100000:3.0:1715206647.757395:0:1957:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800aafdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:cbae74da-7571-45ad-b971-0e0378bbd4e4:1957:1798523503848832:192.168.202.138@tcp:400:kworker.0 00000080:00200080:2.0:1715206647.821635:0:32489:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f588c8) cmd=401866d5 arg=1ec70f0 00800000:00000080:2.0:1715206647.821646:0:32489:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800b061fe80 uarg=0000000000000000 00000002:00000080:2.0:1715206647.821651:0:32489:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800aa1c9800: cmd=401866d5 len=24 karg=ffff8800b061fe80 uarg=0000000000000000 00000100:00100000:2.0:1715206647.821700:0:32489:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800b6327480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32489:1798523503848960:192.168.202.138@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715206647.821765:0:32489:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391780 going to sleep for 145 seconds 00000100:00100000:0.0F:1715206647.822648:0:32489:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32489:1798523503848960:192.168.202.138@tcp:60:lhsmtool_posix.0 00000080:00200008:0.0:1715206647.822689:0:32489:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b08900c8), flags 100000 00000002:00100000:0.0:1715206647.822713:0:32489:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff88012a616a00 x1798523503848256/t4294967405(4294967405) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206795 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:0.0:1715206647.822727:0:32489:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800aa1c9800: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:0.0:1715206647.822730:0:32489:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012aaf5500 x1798523503849088/t0(0) o35->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1715206647.822739:0:32489:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012aaf5500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32489:1798523503849088:192.168.202.138@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1715206647.822767:0:32489:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aaeee840 going to sleep for 11 seconds 00000100:00100000:0.0:1715206647.823543:0:32489:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012aaf5500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:cbae74da-7571-45ad-b971-0e0378bbd4e4:32489:1798523503849088:192.168.202.138@tcp:35:lhsmtool_posix.0 00000002:00100000:0.0:1715206647.823558:0:32489:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff88012a616a00 x1798523503848256/t4294967405(4294967405) o101->lustre-MDT0000-mdc-ffff8800aa1c9800@192.168.202.138@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206795 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:0.0:1715206647.823582:0:32489:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00000080:00200008:0.0:1715206647.825387:0:32489:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff880136f588c8), flags 100000 00010000:00010000:0.0:1715206648.462200:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206649.464185:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206650.466165:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0F:1715206651.247923:0:1380:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11a: Import a file ==================== 18:17:30 (1715206650) 00000080:00200000:2.0:1715206651.260912:0:1385:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715206651.260928:0:1385:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206651.260966:0:1385:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.260973:0:1385:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.260979:0:1385:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00000100:00100000:2.0:1715206651.260990:0:1385:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391300 going to sleep for 0 seconds 00000100:00100000:2.0:1715206651.260998:0:1385:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327480 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:1385:1798523503849152:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715206651.261005:0:1385:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261009:0:1385:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261016:0:1385:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261020:0:1385:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261024:0:1385:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261027:0:1385:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309680 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206651.261029:0:1385:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261033:0:1385:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261037:0:1385:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261054:0:1385:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206651.261058:0:1385:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261061:0:1385:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309680/0xbbeffb005ec3deb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1385 initiator: MDT0 00000080:00020000:2.0:1715206651.261074:0:1385:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:2.0:1715206651.261088:0:1385:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715206651.261092:0:1385:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206651.261103:0:1385:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261112:0:1385:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261116:0:1385:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00000100:00100000:2.0:1715206651.261121:0:1385:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391300 going to sleep for 0 seconds 00000100:00100000:2.0:1715206651.261124:0:1385:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327480 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:1385:1798523503849216:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715206651.261128:0:1385:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261131:0:1385:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261135:0:1385:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261138:0:1385:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261140:0:1385:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261143:0:1385:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa309f80 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206651.261145:0:1385:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261147:0:1385:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261150:0:1385:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261158:0:1385:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206651.261160:0:1385:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261163:0:1385:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa309f80/0xbbeffb005ec3debb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1385 initiator: MDT0 00000080:00020000:2.0:1715206651.261170:0:1385:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:2.0:1715206651.261179:0:1385:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:2.0:1715206651.261182:0:1385:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:2.0:1715206651.261186:0:1385:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715206651.261194:0:1385:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261197:0:1385:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261200:0:1385:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00000100:00100000:2.0:1715206651.261205:0:1385:0:(client.c:2542:ptlrpc_set_wait()) set ffff880137391300 going to sleep for 0 seconds 00000100:00100000:2.0:1715206651.261207:0:1385:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800b6327480 pname:cluuid:pid:xid:nid:opc:job lfs:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:1385:1798523503849280:192.168.202.138@tcp:101:lfs.0 00010000:00010000:2.0:1715206651.261210:0:1385:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261213:0:1385:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261216:0:1385:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261224:0:1385:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261227:0:1385:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261230:0:1385:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa30a1c0 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:2.0:1715206651.261231:0:1385:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261234:0:1385:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261237:0:1385:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261239:0:1385:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1715206651.261241:0:1385:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1385 initiator: MDT0 00010000:00010000:2.0:1715206651.261243:0:1385:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff8800aa30a1c0/0xbbeffb005ec3dec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1385 initiator: MDT0 00000080:00020000:2.0:1715206651.261250:0:1385:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206651.327211:0:1437:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f580c8),name=/ 00000002:00010000:1.0:1715206651.327227:0:1437:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206651.327265:0:1437:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327271:0:1437:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327277:0:1437:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1437 initiator: MDT0 00000100:00100000:1.0:1715206651.327289:0:1437:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa2c5000 going to sleep for 0 seconds 00000100:00100000:1.0:1715206651.327296:0:1437:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a615c00 pname:cluuid:pid:xid:nid:opc:job mkdir:46af332d-2ee7-4d47-b762-82c1eb2b6bbd:1437:1798523503849344:192.168.202.138@tcp:101:mkdir.0 00010000:00010000:1.0:1715206651.327303:0:1437:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327307:0:1437:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327311:0:1437:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327315:0:1437:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327318:0:1437:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327322:0:1437:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff880136bacd80 already unused, calling callback (ffffffffa1044e10) 00010000:00010000:1.0:1715206651.327324:0:1437:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327327:0:1437:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327336:0:1437:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327340:0:1437:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206651.327343:0:1437:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1437 initiator: MDT0 00010000:00010000:1.0:1715206651.327346:0:1437:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b0712000 lock: ffff880136bacd80/0xbbeffb005ec3dec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 1437 initiator: MDT0 00000080:00020000:1.0:1715206651.327361:0:1437:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:1.0:1715206651.468176:0:4776:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715206651.643841:0:1569:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_11a: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d11a.sanity-hsm' Debug log: 118 lines, 118 kept, 0 dropped, 0 bad.