00010000:00010000:1.0F:1715209946.606722:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200080:2.0F:1715209946.975630:0:7843:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=20b30f0 00800000:00000080:2.0:1715209946.975646:0:7843:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a977e180 uarg=0000000000000000 00000002:00000080:2.0:1715209946.975651:0:7843:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a977e180 uarg=0000000000000000 00000100:00100000:2.0:1715209946.975684:0:7843:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d880 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505202112:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715209946.975744:0:7843:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa4bc240 going to sleep for 11 seconds 00000100:00100000:3.0F:1715209946.979467:0:7843:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d880 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505202112:192.168.201.123@tcp:60:lhsmtool_posix.0 00000002:00000080:3.0:1715209946.979501:0:7843:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800a977e180 uarg=0000000000000000 00000100:00100000:3.0:1715209946.979542:0:7843:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e5180 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505202176:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715209946.979622:0:7843:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012db9fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1715209946.981218:0:7843:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5180 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505202176:192.168.201.123@tcp:60:lhsmtool_posix.0 00000080:00200008:3.0:1715209946.981262:0:7843:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:3.0:1715209946.981302:0:7843:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a91e6a00 x1798523505186752/t4294967508(4294967508) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209756 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:3.0:1715209946.981326:0:7843:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1715209946.981332:0:7843:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800a91e5180 x1798523505202304/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715209946.981346:0:7843:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e5180 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505202304:192.168.201.123@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715209946.981381:0:7843:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012db9fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1715209946.982983:0:7843:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5180 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:7843:1798523505202304:192.168.201.123@tcp:35:lhsmtool_posix.0 00000002:00100000:2.0:1715209946.983001:0:7843:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a91e6a00 x1798523505186752/t4294967508(4294967508) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209756 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:2.0:1715209946.983033:0:7843:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200008:3.0:1715209946.985262:0:7843:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000100:00080000:2.0:1715209947.000644:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209947.000658:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209947.000663:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209947.000666:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209947.000668:0:302:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209947.000669:0:302:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715209947.000685:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523505202368:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209947.000724:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505202496:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209947.000746:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523505202432:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209947.002043:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523505202368:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209947.002052:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505202496:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209947.002147:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523505202432:192.168.201.123@tcp:400:kworker.0 00010000:00010000:1.0:1715209947.608755:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715209948.610798:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715209949.398222:0:10951:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 29d: hsm_remove by FID with archive_id 0 for unlinked file cause ========================================================== 19:12:29 (1715209949) 00010000:00010000:1.0:1715209949.612692:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715209949.795337:0:11103:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_29d Need 3 or more clients, have 1 00010000:00010000:1.0:1715209950.614674:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715209951.616704:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1715209952.008646:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209952.008650:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209952.008661:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209952.008663:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209952.008670:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209952.008672:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:3.0:1715209952.008686:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523505202560:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209952.008687:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2003:1798523505202624:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209952.008747:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505202752:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209952.008750:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505202688:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209952.008762:0:2003:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715209952.008765:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505202816:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209952.010210:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523505202560:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209952.010226:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505202688:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209952.010256:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505202816:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209952.010264:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2003:1798523505202624:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209952.010271:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505202752:192.168.201.123@tcp:400:kworker.0 00000001:02000400:1.0:1715209952.183126:0:11381:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 30a: Restore at exec (import case) ==== 19:12:31 (1715209951) 00000001:02000400:3.0:1715209952.594045:0:11535:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_30a Need 2 or more clients, have 1 00010000:00010000:1.0:1715209952.618646:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715209953.620697:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1715209954.622690:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1715209954.839847:0:11812:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 30b: Restore at exec (release case) === 19:12:34 (1715209954) 00000001:02000400:1.0:1715209955.222902:0:11964:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_30b Need 2 or more clients, have 1 00010000:00010000:1.0:1715209955.624696:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715209956.626640:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1715209957.016641:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209957.016645:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209957.016650:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209957.016652:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:2.0:1715209957.016659:0:9970:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1715209957.016661:0:9970:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:2.0:1715209957.016685:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523505202944:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209957.016698:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523505202880:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209957.016750:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505203072:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209957.016752:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505203008:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209957.016773:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505203136:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209957.018052:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523505202880:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209957.018060:0:2003:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9618000: committing for last_committed 4294967517 gen 1 00000100:00100000:2.0:1715209957.018062:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:04532c2b-e5e9-420d-abb0-4480aab1e378:2002:1798523505202944:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209957.018063:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505203008:192.168.201.123@tcp:400:kworker.0 00000100:00100000:3.0:1715209957.018070:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2003:1798523505203136:192.168.201.123@tcp:400:kworker.0 00000100:00100000:2.0:1715209957.018070:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2002:1798523505203072:192.168.201.123@tcp:400:kworker.0 00000001:02000400:3.0:1715209957.443022:0:12241:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 30c: Update during exec of released file must fail ========================================================== 19:12:37 (1715209957) 00010000:00010000:0.0:1715209957.628673:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715209957.827996:0:12393:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-hsm test_30c Need 2 or more clients, have 1 00010000:00010000:0.0:1715209958.630660:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715209959.632690:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715209960.027803:0:12670:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 31a: Import a large file and check size during restore ========================================================== 19:12:39 (1715209959) 00000080:00200008:3.0:1715209960.165211:0:12713:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715209960.165216:0:12713:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715209960.165231:0:12713:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209960.165244:0:12713:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209960.165253:0:12713:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715209960.165260:0:12713:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715209960.165261:0:12713:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:3.0:1715209960.165269:0:12713:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a9257cc8 00010000:00010000:3.0:1715209960.165271:0:12713:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209960.165276:0:12713:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200008:3.0:1715209960.165512:0:12713:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715209960.165515:0:12713:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715209960.165524:0:12713:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209960.165555:0:12713:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165559:0:12713:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165580:0:12713:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12713 initiator: MDT0 00000100:00100000:3.0:1715209960.165593:0:12713:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012db9fd80 going to sleep for 0 seconds 00000100:00100000:3.0:1715209960.165600:0:12713:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:04532c2b-e5e9-420d-abb0-4480aab1e378:12713:1798523505203200:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715209960.165607:0:12713:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165611:0:12713:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165614:0:12713:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165617:0:12713:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165625:0:12713:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165628:0:12713:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609440 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715209960.165631:0:12713:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165634:0:12713:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165638:0:12713:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165642:0:12713:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715209960.165645:0:12713:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12713 initiator: MDT0 00010000:00010000:3.0:1715209960.165648:0:12713:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609440/0x7561918bd557099c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12713 initiator: MDT0 00000080:00020000:3.0:1715209960.165660:0:12713:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:3.0:1715209960.169676:0:12713:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:3.0:1715209960.169680:0:12713:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715209960.169685:0:12713:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209960.169690:0:12713:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209960.169696:0:12713:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715209960.169700:0:12713:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715209960.169705:0:12713:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:3.0:1715209960.169708:0:12713:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a9257cc8 00010000:00010000:3.0:1715209960.169710:0:12713:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209960.169714:0:12713:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715209960.169759:0:12713:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:3.0:1715209960.169765:0:12713:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209960.169768:0:12713:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209960.169773:0:12713:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00010000:3.0:1715209960.169777:0:12713:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:3.0:1715209960.169778:0:12713:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:3.0:1715209960.169780:0:12713:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a9257b80 00010000:00010000:3.0:1715209960.169782:0:12713:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715209960.169786:0:12713:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:3.0:1715209960.169791:0:12713:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:3.0:1715209960.169795:0:12713:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:2.0:1715209960.170208:0:12714:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:2.0:1715209960.170219:0:12714:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715209960.170226:0:12714:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209960.170235:0:12714:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715209960.170244:0:12714:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:2.0:1715209960.170247:0:12714:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:2.0:1715209960.170250:0:12714:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a9397b80 00010000:00010000:2.0:1715209960.170253:0:12714:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209960.170260:0:12714:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715209960.170268:0:12714:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 44 00000080:00200008:2.0:1715209960.170274:0:12714:0:(file.c:871:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200000:2.0:1715209960.170294:0:12714:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8),name=/ 00000002:00010000:2.0:1715209960.170299:0:12714:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:2.0:1715209960.170303:0:12714:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209960.170314:0:12714:0:(ldlm_lock.c:1542:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00010000:2.0:1715209960.170319:0:12714:0:(dcache.c:301:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) 00000080:00010000:2.0:1715209960.170320:0:12714:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8800b02580c8) for lock 0x7561918bd557093a 00000080:00010000:2.0:1715209960.170322:0:12714:0:(dcache.c:194:ll_intent_drop_lock()) releasing lock with cookie 0x7561918bd557093a from it ffff8800a9397bb0 00010000:00010000:2.0:1715209960.170324:0:12714:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715209960.170327:0:12714:0:(ldlm_lock.c:929:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800aa54b180/0x7561918bd557093a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xfa8b5bed87892d78 expref: -99 pid: 7849 timeout: 0 lvb_type: 0 00000080:00200000:2.0:1715209960.170332:0:12714:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715209960.170336:0:12714:0:(dcache.c:318:ll_revalidate_dentry()) VFS Op:name=.lustre, flags=17 00000080:00200000:2.0:1715209960.170339:0:12714:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x1:0x0](ffff880136f410c8), inode mode 41ed mask 1 00000080:00200000:2.0:1715209960.170343:0:12714:0:(namei.c:1183:ll_atomic_open()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), file ffff88013088f380, open_flags 8000, mode 0 opened 0 00000080:00200000:2.0:1715209960.170347:0:12714:0:(namei.c:838:ll_lookup_it()) VFS Op:name=fid, dir=[0x200000002:0x1:0x0](ffff880136f410c8), intent=open 00000002:00010000:2.0:1715209960.170353:0:12714:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: fid,[0x0:0x0:0x0]) in obj [0x200000002:0x1:0x0], intent: open flags 0100001 00010000:00010000:2.0:1715209960.170373:0:12714:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 12714 initiator: MDT0 00010000:00010000:2.0:1715209960.170376:0:12714:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12714 initiator: MDT0 00000020:00100000:2.0:1715209960.170381:0:12714:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 101, max 7 00000100:00100000:2.0:1715209960.170387:0:12714:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8800abe2f480 x1798523505203328/t0(0) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/66536 e 0 to 0 dl 0 ref 1 fl New:PQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1715209960.170392:0:12714:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12714 initiator: MDT0 00000100:00100000:2.0:1715209960.170403:0:12714:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2f480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:12714:1798523505203328:192.168.201.123@tcp:101:lhsmtool_posix.0 00000100:00100000:2.0:1715209960.170506:0:12714:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800aa4bc000 going to sleep for 11 seconds 00000100:00100000:3.0:1715209960.173371:0:12714:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2f480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:12714:1798523505203328:192.168.201.123@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1715209960.173381:0:12714:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (ABORTED) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173390:0:12714:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173394:0:12714:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 4/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173397:0:12714:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x10206400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173400:0:12714:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x206400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173403:0:12714:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923b3c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715209960.173405:0:12714:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173407:0:12714:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 4/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x206400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173410:0:12714:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 5/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x20e400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173413:0:12714:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715209960.173415:0:12714:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 12714 initiator: MDT0 00010000:00010000:3.0:1715209960.173418:0:12714:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800a9618000 lock: ffff8800a923b3c0/0x7561918bd55709a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x1 rrc: 3 type: IBT flags: 0x4a0f400000000 pid: 12714 initiator: MDT0 00000002:00100000:3.0:1715209960.173426:0:12714:0:(mdc_locks.c:838:mdc_finish_enqueue()) @@@ op=1 disposition=2b, status=0 req@ffff8800abe2f480 x1798523505203328/t4294967518(4294967518) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209976 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000002:00100000:3.0:1715209960.173433:0:12714:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800abe2f480 x1798523505203328/t4294967518(4294967518) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209976 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:3.0:1715209960.173450:0:12714:0:(llite_lib.c:2872:ll_update_inode()) inode=[0x200000002:0x2:0x0], updating i_size 4096 00000080:00200000:3.0:1715209960.173452:0:12714:0:(namei.c:157:ll_iget()) got inode: [0x200000002:0x2:0x0](ffff8800b02788c8): rc = 0 00000080:00010000:3.0:1715209960.173455:0:12714:0:(llite_internal.h:1965:ll_set_lock_data()) setting l_data to inode [0x200000002:0x2:0x0](ffff8800b02788c8) for lock 0x0 00000080:00200008:3.0:1715209960.173463:0:12714:0:(file.c:871:ll_file_open()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:3.0:1715209960.173471:0:12714:0:(mdc_request.c:816:mdc_set_open_replay_data()) @@@ Set up open replay data req@ffff8800abe2f480 x1798523505203328/t4294967518(4294967518) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715209976 ref 2 fl Complete:RPQU/204/0 rc 301/301 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200000:3.0:1715209960.173501:0:12714:0:(file.c:6060:ll_inode_permission()) VFS Op:inode=[0x200000002:0x2:0x0](ffff8800b02788c8), inode mode 4040 mask 44 00000080:00200080:3.0:1715209960.173529:0:12714:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=7470f0 00800000:00000080:3.0:1715209960.173534:0:12714:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff88012ab4a420 uarg=0000000000000000 00000002:00000080:3.0:1715209960.173541:0:12714:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff88012ab4a420 uarg=0000000000000000 00000100:00100000:3.0:1715209960.173554:0:12714:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e5500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:12714:1798523505203392:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715209960.173596:0:12714:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012db9f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715209960.174606:0:12714:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:12714:1798523505203392:192.168.201.123@tcp:59:lhsmtool_posix.0 00000002:00000080:3.0:1715209960.174618:0:12714:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff88012ab4a420 uarg=0000000000000000 00000100:00100000:3.0:1715209960.174634:0:12714:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a91e5500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:12714:1798523505203456:192.168.201.123@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1715209960.174662:0:12714:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012db9f6c0 going to sleep for 11 seconds 00000080:00200000:0.0:1715209960.175097:0:12715:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:0.0:1715209960.175105:0:12715:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715209960.175121:0:12715:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175126:0:12715:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175130:0:12715:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00000100:00100000:0.0:1715209960.175136:0:12715:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e5540 going to sleep for 0 seconds 00000100:00100000:0.0:1715209960.175140:0:12715:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:12715:1798523505203520:192.168.201.123@tcp:101:lfs.0 00010000:00010000:0.0:1715209960.175144:0:12715:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175148:0:12715:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175151:0:12715:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175154:0:12715:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175157:0:12715:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175160:0:12715:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa586400 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:0.0:1715209960.175162:0:12715:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175170:0:12715:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175173:0:12715:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175176:0:12715:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715209960.175178:0:12715:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175181:0:12715:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa586400/0x7561918bd55709aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12715 initiator: MDT0 00000080:00020000:0.0:1715209960.175190:0:12715:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:0.0:1715209960.175202:0:12715:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:0.0:1715209960.175207:0:12715:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715209960.175216:0:12715:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175219:0:12715:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175222:0:12715:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00000100:00100000:0.0:1715209960.175227:0:12715:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e5540 going to sleep for 0 seconds 00000100:00100000:0.0:1715209960.175230:0:12715:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:12715:1798523505203584:192.168.201.123@tcp:101:lfs.0 00010000:00010000:0.0:1715209960.175233:0:12715:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175236:0:12715:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175244:0:12715:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175247:0:12715:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175250:0:12715:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175252:0:12715:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa5858c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:0.0:1715209960.175254:0:12715:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175257:0:12715:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175260:0:12715:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175262:0:12715:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715209960.175264:0:12715:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175266:0:12715:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5858c0/0x7561918bd55709b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12715 initiator: MDT0 00000080:00020000:0.0:1715209960.175274:0:12715:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:0.0:1715209960.175282:0:12715:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:0.0:1715209960.175284:0:12715:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:0.0:1715209960.175287:0:12715:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1715209960.175295:0:12715:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175301:0:12715:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175305:0:12715:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00000100:00100000:0.0:1715209960.175309:0:12715:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e5540 going to sleep for 0 seconds 00000100:00100000:0.0:1715209960.175311:0:12715:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6d80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:12715:1798523505203648:192.168.201.123@tcp:101:lfs.0 00010000:00010000:0.0:1715209960.175369:0:12715:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175373:0:12715:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175376:0:12715:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175379:0:12715:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175382:0:12715:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175384:0:12715:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa5873c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:0.0:1715209960.175386:0:12715:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175388:0:12715:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175391:0:12715:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175399:0:12715:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1715209960.175401:0:12715:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12715 initiator: MDT0 00010000:00010000:0.0:1715209960.175404:0:12715:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa5873c0/0x7561918bd55709b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12715 initiator: MDT0 00000080:00020000:0.0:1715209960.175413:0:12715:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000100:00100000:3.0:1715209960.175486:0:12714:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5500 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:12714:1798523505203456:192.168.201.123@tcp:59:lhsmtool_posix.0 00000080:00200000:3.0:1715209960.566470:0:12750:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715209960.566489:0:12750:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715209960.566531:0:12750:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566537:0:12750:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566548:0:12750:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12750 initiator: MDT0 00000100:00100000:3.0:1715209960.566559:0:12750:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012db9f9c0 going to sleep for 0 seconds 00000100:00100000:3.0:1715209960.566584:0:12750:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a91e5500 pname:cluuid:pid:xid:nid:opc:job mkdir:04532c2b-e5e9-420d-abb0-4480aab1e378:12750:1798523505203712:192.168.201.123@tcp:101:mkdir.0 00010000:00010000:3.0:1715209960.566591:0:12750:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566595:0:12750:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566599:0:12750:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566602:0:12750:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566606:0:12750:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566610:0:12750:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9609b00 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715209960.566613:0:12750:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566616:0:12750:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566620:0:12750:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566624:0:12750:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715209960.566627:0:12750:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12750 initiator: MDT0 00010000:00010000:3.0:1715209960.566633:0:12750:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800a9609b00/0x7561918bd55709bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 12750 initiator: MDT0 00000080:00020000:3.0:1715209960.566647:0:12750:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00010000:00010000:0.0:1715209960.634694:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1715209960.891602:0:12886:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_31a: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d31a.sanity-hsm' Debug log: 288 lines, 288 kept, 0 dropped, 0 bad.