00000080:00200080:3.0F:1715206660.528823:0:1196:0:(dir.c:1969:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8800b02580c8) cmd=401866d5 arg=14cf0f0 00800000:00000080:3.0:1715206660.528841:0:1196:0:(lmv_obd.c:911:lmv_iocontrol()) lustre-clilmv-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b3a4c240 uarg=0000000000000000 00000002:00000080:3.0:1715206660.528848:0:1196:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0000-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b3a4c240 uarg=0000000000000000 00000100:00100000:3.0:1715206660.528910:0:1196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a413480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:1196:1798523504924992:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1715206660.528989:0:1196:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421e40 going to sleep for 143 seconds 00000100:00100000:2.0F:1715206660.530080:0:1196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413480 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:1196:1798523504924992:192.168.201.123@tcp:60:lhsmtool_posix.0 00000002:00000080:2.0:1715206660.530112:0:1196:0:(mdc_request.c:2233:mdc_iocontrol()) lustre-MDT0001-mdc-ffff8800a9618000: cmd=401866d5 len=24 karg=ffff8800b3a4c240 uarg=0000000000000000 00000100:00100000:2.0:1715206660.530132:0:1196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2ca80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:1196:1798523504925056:192.168.201.123@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1715206660.530163:0:1196:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 143 seconds 00000100:00100000:3.0:1715206660.530695:0:1196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2ca80 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:1196:1798523504925056:192.168.201.123@tcp:60:lhsmtool_posix.0 00000080:00200008:3.0:1715206660.530723:0:1196:0:(file.c:430:ll_file_release()) START file fid:[0x200000002:0x2:0x0](ffff8800b02788c8), flags 100000 00000002:00100000:3.0:1715206660.530760:0:1196:0:(mdc_request.c:927:mdc_close()) @@@ matched open req@ffff8800a96a7480 x1798523504924416/t4294967384(4294967384) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206806 ref 1 fl Complete:RPQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000020:00100000:3.0:1715206660.530781:0:1196:0:(genops.c:2297:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff8800a9618000: modify RPC slot 1 is allocated opc 35, max 7 00000100:00100000:3.0:1715206660.530787:0:1196:0:(client.c:765:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff88012a413100 x1798523504925184/t0(0) o35->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:23/10 lens 392/840 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1715206660.530799:0:1196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a413100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:1196:1798523504925184:192.168.201.123@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1715206660.530833:0:1196:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715206660.531652:0:1196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413100 pname:cluuid:pid:xid:nid:opc:job lhsmtool_posix:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:1196:1798523504925184:192.168.201.123@tcp:35:lhsmtool_posix.0 00000002:00100000:3.0:1715206660.531665:0:1196:0:(mdc_request.c:837:mdc_free_open()) @@@ free open request, rq_replay=0 req@ffff8800a96a7480 x1798523504924416/t4294967384(4294967384) o101->lustre-MDT0000-mdc-ffff8800a9618000@192.168.201.123@tcp:12/10 lens 864/608 e 0 to 0 dl 1715206806 ref 1 fl Complete:RQU/204/ffffffff rc 301/-1 job:'lhsmtool_posix.0' uid:0 gid:0 00000080:00200008:3.0:1715206660.531688:0:1196:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00000080:00200008:0.0F:1715206660.533581:0:1196:0:(file.c:430:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8800b02580c8), flags 100000 00010000:00010000:0.0:1715206661.040800:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206662.042849:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0F:1715206662.841018:0:2439:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-hsm test 11c: Import a file to a directory with a pool ========================================================== 18:17:42 (1715206662) 00000100:00080000:1.0:1715206663.000765:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1715206663.000774:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:1.0:1715206663.000786:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1715206663.000790:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:1.0:1715206663.000803:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1715206663.000806:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715206663.000814:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504925248:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206663.000849:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523504925312:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206663.000893:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504925440:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206663.000893:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504925376:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206663.000920:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504925504:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206663.002833:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523504925312:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206663.002839:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a967a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504925504:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206663.002839:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504925440:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206663.002850:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504925248:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206663.002858:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504925376:192.168.201.123@tcp:400:kworker.0 00010000:00010000:0.0:1715206663.044858:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715206663.181139:0:1993:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:1.0:1715206663.181274:0:12808:0:(service.c:168:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1715206663.181309:0:12808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510322816 00000100:00100000:1.0:1715206663.181318:0:12808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510322816 00000100:00100000:1.0:1715206663.181394:0:12808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 34 00000100:00100000:1.0:1715206663.181403:0:12808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+3:11142:x1798523510322816:12345-192.168.201.123@tcp:104: 00010000:00010000:1.0:1715206663.181418:0:12808:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206663.181498:0:12808:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1715206663.181504:0:12808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+3:11142:x1798523510322816:12345-192.168.201.123@tcp:104: Request processed in 102us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206663.181527:0:12808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 34 00010000:00010000:3.0:1715206663.181543:0:5362:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715206663.181552:0:5362:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.181560:0:5362:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa668480 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:3.0:1715206663.181600:0:5362:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.181617:0:5362:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715206663.181622:0:5362:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715206663.181625:0:5362:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1715206663.181672:0:5362:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.181676:0:5362:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715206663.181695:0:5362:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.181700:0:5362:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800aa668480/0x7561918bd556f751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890cb6 expref: -99 pid: 7942 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.181721:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206663.181722:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206663.181724:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206663.181730:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504925568:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1715206663.181886:0:1993:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206663.181904:0:12808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510323776 00000100:00100000:0.0:1715206663.181965:0:12808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510323776 00000100:00100000:1.0:1715206663.181986:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206663.181988:0:12808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 35 00000100:00100000:0.0:1715206663.181993:0:12808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a967a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+3:11142:x1798523510323776:12345-192.168.201.123@tcp:104: 00010000:00010000:0.0:1715206663.182002:0:12808:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715206663.182003:0:5352:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510323904 00000100:00100000:1.0:1715206663.182007:0:5352:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510323904 00000100:00100000:1.0:1715206663.182023:0:5352:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 36 00000100:00100000:1.0:1715206663.182027:0:5352:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a9679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+4:11142:x1798523510323904:12345-192.168.201.123@tcp:104: 00010000:00010000:1.0:1715206663.182036:0:5352:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206663.182045:0:12808:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1715206663.182051:0:12808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a967a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+4:11142:x1798523510323776:12345-192.168.201.123@tcp:104: Request processed in 57us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1715206663.182057:0:12808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 35 00010000:00010000:1.0:1715206663.182076:0:5352:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1715206663.182079:0:18185:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1715206663.182081:0:5352:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a9679880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+3:11142:x1798523510323904:12345-192.168.201.123@tcp:104: Request processed in 53us (95us total) trans 0 rc 0/0 00010000:00010000:2.0:1715206663.182087:0:18185:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715206663.182088:0:5352:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 36 00010000:00010000:2.0:1715206663.182096:0:18185:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa5ec240 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:2.0:1715206663.182099:0:18185:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206663.182105:0:18185:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1715206663.182109:0:18185:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206663.182112:0:18185:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1715206663.182133:0:18185:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.182134:0:5362:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715206663.182138:0:18185:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715206663.182150:0:18185:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206663.182155:0:18185:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800aa5ec240/0x7561918bd556f743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890beb expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206663.182171:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206663.182180:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206663.182183:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206663.182198:0:2003:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1715206663.182207:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504925632:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715206663.182298:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206663.182300:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206663.182302:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206663.182315:0:5362:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.182322:0:5362:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa584d80 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:3.0:1715206663.182325:0:5362:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.182330:0:5362:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715206663.182341:0:5362:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1715206663.182345:0:5362:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1715206663.182377:0:5362:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.182381:0:5362:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715206663.182405:0:5362:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206663.182409:0:5362:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800aa584d80/0x7561918bd556f73c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87890be4 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206663.182421:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504925696:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1715206663.182423:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206663.182424:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206663.182425:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206663.182522:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504925568:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206663.182998:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504925632:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206663.183137:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a410000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504925696:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715206664.046932:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1715206664.707660:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206664.707671:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800a9618000 from 52 10000000:01000000:2.0:1715206664.707677:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206664.707739:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.707753:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.707767:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206664.707802:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504925760:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206664.707911:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715206664.710417:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504925760:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206664.710450:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.710495:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206664.710631:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504925824:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206664.710699:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715206664.712218:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504925824:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206664.712264:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504925888:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206664.712375:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715206664.713859:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504925888:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1715206664.714432:0:2471:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2471:1798523504925952:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715206664.714540:0:2471:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1715206664.716260:0:2471:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2471:1798523504925952:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715206664.716301:0:2471:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1715206664.716310:0:2471:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715206664.716313:0:2471:0:(obd_config.c:1497:class_process_config()) marker 44 (0x1) lustre-clilov new lustre.test_11c 00000020:01000000:1.0:1715206664.716319:0:2471:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800a9618000 00000020:00000080:1.0:1715206664.716322:0:2471:0:(obd_config.c:1409:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1715206664.716366:0:2471:0:(lov_pool.c:438:lov_pool_new()) test_11c is pool #1 00000100:00100000:1.0:1715206664.716401:0:2471:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2471:1798523504926016:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:1.0:1715206664.716473:0:2471:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd300 going to sleep for 11 seconds 00000100:00100000:1.0:1715206664.718239:0:2471:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2471:1798523504926016:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:1.0:1715206664.718288:0:2471:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1715206664.718296:0:2471:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1715206664.718299:0:2471:0:(obd_config.c:1497:class_process_config()) marker 44 (0x2) lustre-clilov new lustre.test_11c 00000040:00080000:1.0:1715206664.718304:0:2471:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1715206664.718490:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1715206664.718514:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206664.718523:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.718535:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206664.718546:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206664.718549:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800b6238800 from 52 10000000:01000000:2.0:1715206664.718551:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206664.718610:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.718619:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.718628:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206664.718655:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926080:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206664.718711:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1715206664.720083:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926080:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206664.720101:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.720112:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206664.720157:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926144:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206664.720209:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206664.721752:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926144:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1715206664.721801:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926208:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206664.721883:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715206664.723503:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926208:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206664.723832:0:2472:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2472:1798523504926272:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206664.723906:0:2472:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421a80 going to sleep for 11 seconds 00000100:00100000:3.0:1715206664.725517:0:2472:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2472:1798523504926272:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206664.725553:0:2472:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206664.725601:0:2472:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206664.725603:0:2472:0:(obd_config.c:1497:class_process_config()) marker 44 (0x1) lustre-clilov new lustre.test_11c 00000020:01000000:3.0:1715206664.725611:0:2472:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce020, instance name: lustre-clilov-ffff8800b6238800 00000020:00000080:3.0:1715206664.725613:0:2472:0:(obd_config.c:1409:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1715206664.725629:0:2472:0:(lov_pool.c:438:lov_pool_new()) test_11c is pool #1 00000100:00100000:3.0:1715206664.725655:0:2472:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2472:1798523504926336:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206664.725723:0:2472:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421240 going to sleep for 11 seconds 00000100:00100000:3.0:1715206664.727251:0:2472:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2472:1798523504926336:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206664.727286:0:2472:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206664.727293:0:2472:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206664.727295:0:2472:0:(obd_config.c:1497:class_process_config()) marker 44 (0x2) lustre-clilov new lustre.test_11c 00000040:00080000:3.0:1715206664.727300:0:2472:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1715206664.727382:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1715206664.727409:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1715206664.727416:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206664.727441:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1715206664.727450:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1715206664.727453:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa660000 from 1 10000000:01000000:0.0:1715206664.727456:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1715206664.727477:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206664.727484:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206664.727493:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715206664.727511:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926400:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1715206664.727594:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e5300 going to sleep for 11 seconds 00000100:00100000:2.0:1715206664.729008:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926400:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206664.729028:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.729039:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206664.729089:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926464:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206664.729143:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1715206664.730648:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926464:192.168.201.123@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1715206664.730672:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1715206664.730678:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206664.730699:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.048966:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715206665.964905:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206665.964943:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:0.0:1715206665.964967:0:1992:0:(events.c:359:request_in_callback()) peer: 12345-192.168.201.123@tcp (source: 12345-192.168.201.123@tcp) 00000100:00100000:1.0:1715206665.964973:0:5352:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510327616 00000100:00100000:1.0:1715206665.964982:0:5352:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510327616 00000100:00100000:0.0:1715206665.964983:0:5351:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510327680 00000100:00100000:0.0:1715206665.964987:0:5351:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510327680 00000100:00100000:1.0:1715206665.965006:0:5352:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1798523510327744 00000100:00100000:1.0:1715206665.965007:0:5352:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1798523510327744 00000100:00100000:0.0:1715206665.965010:0:5351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 37 00000100:00100000:0.0:1715206665.965016:0:5351:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:11352:x1798523510327680:12345-192.168.201.123@tcp:104: 00000100:00100000:1.0:1715206665.965017:0:5352:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 38 00000100:00100000:1.0:1715206665.965021:0:5352:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:11352:x1798523510327616:12345-192.168.201.123@tcp:104: 00010000:00010000:1.0:1715206665.965029:0:5352:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206665.965029:0:5351:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.965081:0:5352:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206665.965085:0:5352:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+5:11352:x1798523510327616:12345-192.168.201.123@tcp:104: Request processed in 64us (189us total) trans 0 rc 0/0 00010000:00010000:0.0:1715206665.965085:0:5351:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1715206665.965090:0:5352:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 38 00000100:00100000:0.0:1715206665.965101:0:5351:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+4:11352:x1798523510327680:12345-192.168.201.123@tcp:104: Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206665.965102:0:5352:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.123@tcp, seq: 39 00000100:00100000:1.0:1715206665.965105:0:5352:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a96a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+4:11352:x1798523510327744:12345-192.168.201.123@tcp:104: 00000100:00100000:0.0:1715206665.965108:0:5351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 37 00010000:00010000:1.0:1715206665.965109:0:5352:0:(ldlm_lockd.c:2536:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.965123:0:5352:0:(ldlm_lockd.c:2227:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1715206665.965126:0:5352:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a96a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd+3:11352:x1798523510327744:12345-192.168.201.123@tcp:104: Request processed in 20us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1715206665.965135:0:5352:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.123@tcp, seq: 39 00010000:00010000:1.0:1715206665.965145:0:2469:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1715206665.965147:0:5362:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715206665.965150:0:2469:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206665.965153:0:5362:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.965154:0:2469:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa586400 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:1.0:1715206665.965156:0:2469:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206665.965158:0:5362:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a923a1c0 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:3.0:1715206665.965160:0:5362:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.965161:0:2469:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206665.965165:0:5362:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715206665.965165:0:2469:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1715206665.965168:0:5362:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715206665.965168:0:2469:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1715206665.965171:0:5362:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1715206665.965182:0:18185:0:(ldlm_lockd.c:2857:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715206665.965200:0:5362:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.965200:0:2469:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206665.965203:0:5362:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715206665.965203:0:2469:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715206665.965214:0:2469:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.965218:0:2469:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800aa586400/0x7561918bd556fcde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a1c expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206665.965220:0:5362:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206665.965224:0:5362:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a15 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715206665.965229:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206665.965230:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715206665.965231:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206665.965234:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715206665.965234:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715206665.965235:0:2003:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1715206665.965235:0:2000:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1715206665.965236:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715206665.965243:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504926528:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1715206665.965246:0:2003:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504926592:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1715206665.965362:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206665.965365:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715206665.965366:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206665.965388:0:18185:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206665.965395:0:18185:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800a9239f80 already unused, calling callback (ffffffffa0af8a40) 10000000:00010000:2.0:1715206665.965398:0:18185:0:(mgc_request.c:918:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206665.965404:0:18185:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1715206665.965410:0:18185:0:(mgc_request.c:924:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206665.965414:0:18185:0:(mgc_request.c:928:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1715206665.965439:0:18185:0:(ldlm_request.c:1347:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206665.965444:0:18185:0:(ldlm_request.c:1389:_ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715206665.965461:0:18185:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206665.965467:0:18185:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xfa8b5bed87891a0e expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715206665.965472:0:2002:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1715206665.965480:0:2002:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504926656:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1715206665.965482:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206665.965489:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715206665.965491:0:18185:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715206665.965941:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504926528:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715206665.965963:0:2003:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2003:1798523504926592:192.168.201.123@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1715206665.966115:0:2002:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2002:1798523504926656:192.168.201.123@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1715206666.050783:0:2469:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1715206666.699684:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1715206666.699690:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800a9618000 from 55 10000000:01000000:0.0:1715206666.699694:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1715206666.699727:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206666.699735:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715206666.699742:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715206666.699766:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926720:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:0.0:1715206666.699828:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e1e5180 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.701338:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926720:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206666.701351:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.701358:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206666.701399:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926784:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.701427:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.702262:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926784:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.702283:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926848:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.702327:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.703149:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504926848:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206666.703375:0:2529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2529:1798523504926912:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206666.703412:0:2529:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a4213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206666.704134:0:2529:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2529:1798523504926912:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206666.704153:0:2529:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206666.704159:0:2529:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206666.704160:0:2529:0:(obd_config.c:1497:class_process_config()) marker 47 (0x1) lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:3.0:1715206666.704164:0:2529:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800a9618000 00000020:00000080:3.0:1715206666.704165:0:2529:0:(obd_config.c:1409:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1715206666.704176:0:2529:0:(lov_pool.c:569:lov_pool_add()) Added lustre-OST0001_UUID to test_11c as member 1 00000100:00100000:3.0:1715206666.704188:0:2529:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2529:1798523504926976:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206666.704217:0:2529:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a4213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206666.704803:0:2529:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2529:1798523504926976:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206666.704827:0:2529:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206666.704831:0:2529:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206666.704832:0:2529:0:(obd_config.c:1497:class_process_config()) marker 47 (0x2) lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1715206666.704835:0:2529:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1715206666.704882:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1715206666.704894:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206666.704897:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.704903:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800aa5873c0/0x7561918bd556fce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891aa8 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206666.704907:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1715206666.704909:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-client-ffff8800b6238800 from 55 10000000:01000000:2.0:1715206666.704910:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1715206666.704920:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.704928:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.704932:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206666.704940:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927040:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.704964:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.705525:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927040:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206666.705531:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.705535:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206666.705553:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927104:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.705588:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.706232:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927104:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.706247:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927168:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.706274:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.706961:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927168:192.168.201.123@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1715206666.707100:0:2530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2530:1798523504927232:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206666.707134:0:2530:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a4213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206666.707755:0:2530:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2530:1798523504927232:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206666.707772:0:2530:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1715206666.707775:0:2530:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206666.707777:0:2530:0:(obd_config.c:1497:class_process_config()) marker 47 (0x1) lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 00000020:01000000:3.0:1715206666.707780:0:2530:0:(obd_config.c:1941:class_config_llog_handler()) cmd ce021, instance name: lustre-clilov-ffff8800b6238800 00000020:00000080:3.0:1715206666.707781:0:2530:0:(obd_config.c:1409:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1715206666.707787:0:2530:0:(lov_pool.c:569:lov_pool_add()) Added lustre-OST0001_UUID to test_11c as member 1 00000100:00100000:3.0:1715206666.707798:0:2530:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2530:1798523504927296:192.168.201.123@tcp:502:llog_process_th.0 00000100:00100000:3.0:1715206666.707827:0:2530:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a4213c0 going to sleep for 11 seconds 00000100:00100000:3.0:1715206666.708386:0:2530:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2530:1798523504927296:192.168.201.123@tcp:502:llog_process_th.0 00000020:01000000:3.0:1715206666.708405:0:2530:0:(obd_config.c:1826:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1715206666.708408:0:2530:0:(obd_config.c:1409:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1715206666.708410:0:2530:0:(obd_config.c:1497:class_process_config()) marker 47 (0x2) lustre-clilov add lustre.test_11c.lustre-OST0001_UUID 00000040:00080000:3.0:1715206666.708413:0:2530:0:(llog.c:792:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1715206666.708448:0:5364:0:(obd_config.c:2079:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1715206666.708458:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1715206666.708461:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.708471:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a9239f80/0x7561918bd556fcec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891aaf expref: -99 pid: 5364 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715206666.708476:0:5364:0:(mgc_request.c:626:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1715206666.708477:0:5364:0:(mgc_request.c:1762:mgc_process_log()) Process log lustre-sptlrpc-ffff8800aa660000 from 1 10000000:01000000:2.0:1715206666.708478:0:5364:0:(mgc_request.c:991:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1715206666.708487:0:5364:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.708491:0:5364:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.708496:0:5364:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206666.708504:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927360:192.168.201.123@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.708529:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.709224:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927360:192.168.201.123@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1715206666.709234:0:5364:0:(ldlm_lock.c:1089:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.709242:0:5364:0:(ldlm_request.c:808:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715206666.709270:0:5364:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927424:192.168.201.123@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1715206666.709310:0:5364:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012aa8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1715206666.709932:0:5364:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800abe2d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:5364:1798523504927424:192.168.201.123@tcp:501:ll_cfg_requeue.0 10000000:01000000:2.0:1715206666.709953:0:5364:0:(mgc_request.c:1839:mgc_process_log()) MGC192.168.201.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1715206666.709956:0:5364:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715206666.709961:0:5364:0:(ldlm_lock.c:936:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.123@tcp lock: ffff8800a923a1c0/0x7561918bd556fcf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xfa8b5bed87891ab6 expref: -99 pid: 5364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715206667.052763:0:5362:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200000:1.0:1715206667.444550:0:2562:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206667.444582:0:2562:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206667.444620:0:2562:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444627:0:2562:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444632:0:2562:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2562 initiator: MDT0 00000100:00100000:1.0:1715206667.444645:0:2562:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd780 going to sleep for 0 seconds 00000100:00100000:1.0:1715206667.444653:0:2562:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job mkdir:04532c2b-e5e9-420d-abb0-4480aab1e378:2562:1798523504927488:192.168.201.123@tcp:101:mkdir.0 00010000:00010000:1.0:1715206667.444659:0:2562:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444663:0:2562:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444667:0:2562:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444670:0:2562:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444674:0:2562:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444678:0:2562:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa668480 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206667.444683:0:2562:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444687:0:2562:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444691:0:2562:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444694:0:2562:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206667.444698:0:2562:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2562 initiator: MDT0 00010000:00010000:1.0:1715206667.444701:0:2562:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa668480/0x7561918bd556fcfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2562 initiator: MDT0 00000080:00020000:1.0:1715206667.444715:0:2562:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206667.447333:0:2563:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206667.447340:0:2563:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206667.447354:0:2563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447359:0:2563:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447363:0:2563:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00000100:00100000:1.0:1715206667.447368:0:2563:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd780 going to sleep for 0 seconds 00000100:00100000:1.0:1715206667.447372:0:2563:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:2563:1798523504927552:192.168.201.123@tcp:101:lfs.0 00010000:00010000:1.0:1715206667.447377:0:2563:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447380:0:2563:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447386:0:2563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447389:0:2563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447392:0:2563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447395:0:2563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa669680 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206667.447396:0:2563:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447399:0:2563:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447402:0:2563:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447405:0:2563:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206667.447407:0:2563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447409:0:2563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa669680/0x7561918bd556fd01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2563 initiator: MDT0 00000080:00020000:1.0:1715206667.447419:0:2563:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:1.0:1715206667.447432:0:2563:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206667.447436:0:2563:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206667.447445:0:2563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447453:0:2563:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447457:0:2563:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00000100:00100000:1.0:1715206667.447462:0:2563:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd780 going to sleep for 0 seconds 00000100:00100000:1.0:1715206667.447464:0:2563:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:2563:1798523504927616:192.168.201.123@tcp:101:lfs.0 00010000:00010000:1.0:1715206667.447468:0:2563:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447471:0:2563:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447474:0:2563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447477:0:2563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447480:0:2563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447483:0:2563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa66a400 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206667.447484:0:2563:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447487:0:2563:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447489:0:2563:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447497:0:2563:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206667.447498:0:2563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447501:0:2563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a400/0x7561918bd556fd08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2563 initiator: MDT0 00000080:00020000:1.0:1715206667.447509:0:2563:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200008:1.0:1715206667.447520:0:2563:0:(file.c:5701:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff880136f400c8), request_mask 2047, flags 0, foreign 0 00000080:00200000:1.0:1715206667.447524:0:2563:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:1.0:1715206667.447530:0:2563:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1715206667.447543:0:2563:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447548:0:2563:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447553:0:2563:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00000100:00100000:1.0:1715206667.447579:0:2563:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800ad7dd780 going to sleep for 0 seconds 00000100:00100000:1.0:1715206667.447584:0:2563:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a9678a80 pname:cluuid:pid:xid:nid:opc:job lfs:04532c2b-e5e9-420d-abb0-4480aab1e378:2563:1798523504927680:192.168.201.123@tcp:101:lfs.0 00010000:00010000:1.0:1715206667.447591:0:2563:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447596:0:2563:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447601:0:2563:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447614:0:2563:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447619:0:2563:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447623:0:2563:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa66a1c0 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:1.0:1715206667.447626:0:2563:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447631:0:2563:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447636:0:2563:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447641:0:2563:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1715206667.447643:0:2563:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2563 initiator: MDT0 00010000:00010000:1.0:1715206667.447648:0:2563:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa66a1c0/0x7561918bd556fd0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2563 initiator: MDT0 00000080:00020000:1.0:1715206667.447661:0:2563:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000080:00200000:3.0:1715206667.516981:0:2600:0:(file.c:5598:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff880136f400c8),name=/ 00000002:00010000:3.0:1715206667.517000:0:2600:0:(mdc_locks.c:1426:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1715206667.517037:0:2600:0:(ldlm_lock.c:791:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517044:0:2600:0:(ldlm_request.c:1038:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517054:0:2600:0:(ldlm_request.c:1125:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2600 initiator: MDT0 00000100:00100000:3.0:1715206667.517070:0:2600:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012a421300 going to sleep for 0 seconds 00000100:00100000:3.0:1715206667.517081:0:2600:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012a412d80 pname:cluuid:pid:xid:nid:opc:job mkdir:04532c2b-e5e9-420d-abb0-4480aab1e378:2600:1798523504927744:192.168.201.123@tcp:101:mkdir.0 00010000:00010000:3.0:1715206667.517090:0:2600:0:(ldlm_request.c:655:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517096:0:2600:0:(ldlm_request.c:572:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517101:0:2600:0:(ldlm_lock.c:845:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517106:0:2600:0:(ldlm_lock.c:906:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x10206400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517111:0:2600:0:(ldlm_lockd.c:1947:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x206400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517116:0:2600:0:(ldlm_lockd.c:1961:ldlm_handle_bl_callback()) Lock ffff8800aa549d40 already unused, calling callback (ffffffffa1034e10) 00010000:00010000:3.0:1715206667.517119:0:2600:0:(ldlm_request.c:1599:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517124:0:2600:0:(ldlm_request.c:1609:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 4/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x206400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517130:0:2600:0:(ldlm_request.c:1300:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 5/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x20e400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517135:0:2600:0:(ldlm_request.c:1316:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1715206667.517139:0:2600:0:(ldlm_lockd.c:1971:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2600 initiator: MDT0 00010000:00010000:3.0:1715206667.517148:0:2600:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff8800b6238800 lock: ffff8800aa549d40/0x7561918bd556fd16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT flags: 0x4a0f400000000 pid: 2600 initiator: MDT0 00000080:00020000:3.0:1715206667.517167:0:2600:0:(file.c:5575:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000007:0x1:0x0] error: rc = -108 00000001:02000400:1.0:1715206667.826229:0:2736:0:(debug.c:705:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-hsm test_11c: @@@@@@ FAIL: cannot create directory '/mnt/lustre/d11c.sanity-hsm' 00000100:00080000:0.0:1715206668.008756:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206668.008761:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715206668.008769:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1715206668.008772:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 04532c2b-e5e9-420d-abb0-4480aab1e378->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1715206668.008781:0:12483:0:(pinger.c:253:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: level EVICTED/10 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1715206668.008782:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504927808:192.168.201.123@tcp:400:kworker.0 00000100:00080000:0.0:1715206668.008783:0:12483:0:(pinger.c:271:ptlrpc_pinger_process_import()) 1bc50a3e-f07c-4b55-83c3-5f3c3d406528->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00100000:0.0:1715206668.008809:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523504927872:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206668.008845:0:2001:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504928000:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206668.008847:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504927936:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206668.008878:0:2000:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a96a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504928064:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206668.009992:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:04532c2b-e5e9-420d-abb0-4480aab1e378:2001:1798523504927872:192.168.201.123@tcp:400:kworker.0 00000100:00100000:0.0:1715206668.009999:0:2001:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2001:1798523504928000:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206668.010015:0:2000:0:(client.c:2956:ptlrpc_free_committed()) lustre-MDT0000-mdc-ffff8800a9618000: committing for last_committed 4294967385 gen 1 00000100:00100000:1.0:1715206668.010026:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504927936:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206668.010034:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1bc50a3e-f07c-4b55-83c3-5f3c3d406528:2000:1798523504928064:192.168.201.123@tcp:400:kworker.0 00000100:00100000:1.0:1715206668.010039:0:2000:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a96a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e7a1b67-d841-4c3c-9f35-ded8f965b8dd:2000:1798523504927808:192.168.201.123@tcp:400:kworker.0 00010000:00010000:0.0:1715206668.054693:0:2527:0:(ldlm_lockd.c:2860:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 507 lines, 507 kept, 0 dropped, 0 bad.